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ABSTRACT 


invordemetosinvestigatesthemresponse ofehaghtschool 
students to poetic language an experimental poetry test 
using a "variant versions" technique was developed and 
administerea to a sample of Grade X and XII students. 
Interviews based on test resocnses were then conducted 
with a representative sub-sample of students. 

TheshcertryiTestawassconstructedtiacceording tosfour 
Categoriess labeled Thought, Suggestion, Sound and Rhythm. 
An attempt was made by means of a number of pilot studies 
to develop two parallel forms, each consisting of 16 
items, four in each subtest. 

Item analysis was conducted to determine the 
difficulty and; discriminating power of each item and to 
providendetailsd anformation about item response patterns. 
Intercorrelations among the four subtests and between the 
Poetry Test results and scores on a standardized reading 
test were obtaincd to determine possible patterns of 
correspondence. Two-way analyses of variance were con- 
ducted to compare the influence of grade level, sex, and 
general reading tabilatysonsPoetry Test performance. A 
eeeneues compere analysis was also performed in an 
aLteMeLEtoalaewerty™ UNderiving =tactors in sesponse to 
poetic language. The recezded interviews were then 
analyzed in order to supplement the statistical findings. 
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The results indicated that the investigatory 
procedure, employed: in the studyewas a wseful means for 
examining student response to poetic language. While the 
two forms were not statistically equivalent, the Poetry 
Lestawase~ ound adequately reluaeble andiwalideforsits 
purposes, capable of providing a wide range of detailed 
information. 

Item anaiysis showed test items generally too difficult 
Hor thenGrade Xestudentsabut suitabiletlforaGradeixi lv students. 
The mean item discriminating level was higher for the Grade 
Meehan Lore tner Grades xXustudentsr 

The low positive correlations found among perform- 
ances on each of the subtests and between Poetry Test and 
Reading Test performance indicated that the construct 
measured is a complex of partially discrete but inter- 
related skills and that the two tests measure markedly 
different abilities. 

Poetry Test performance was found to be more closely 
related to grade level than to reading level (as measured by 
the Nelson-Denny Test). No Significant connection was found 
between sex and Poetry Test performance. 

Hacvon awolycee meincdinds indicated. threes Tactors 
which appeared to correspond to "everyday", “poetic”, and 
‘ge RAL uses of language. These factor patterns bore 
Nittle relationehip tm test categories, based on a tradi= 
Evora orgdnazatlonm Ob pogeaic elements. 
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The interview results showed that the respondents 
were generally able to give clear reasons for choices 
within the test items. There was found to be a close 
relationship between the "correctness of approach" and the 
correctness of the answer. The students interviewed 
displayed certain common characteristics, such as ignorance 
of poetic terminology, but the high scorers tended to 
approach the language of a poem on several levels of meaning 
while the low scurers tended to operate on the discursive 
level only. The interview findings also revealed that 
superior test performance was accompanied by enjoyment of 


the poems, and a dispositicn to read poems intensively. 
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CHAPTERS. 
INTRODUCTION TO THE PROBLEM 
BACKGROUND OF THE PROBLEM 


Ruommchesitimel of Platopand Aristotle,) much hasi been 
Wil CLEnmaDOuLMEenabure and Muncticnsesof poetry, mutsmost 
of what is known about these matters has been provided by 
highly sensitive readers, many of them poets themselves. 

In ondermMLOnlLeach poetry errectively teachers iff English 
need amclearminderstandanganoOtonly of the nature of poetry 
itself but also of the interaction between a poem and its 
Beadenus. 

At present exact knowledge of what really happens 
when an ordinary reader encounters a poem is lacking. This 
kind of knowledge requires objective, systematic research 
of the kind picneered by Richards and reported in Practical 
Criticism.* It is indeed important that English teachers be 
intimately conversant with the rich store of intuitive 
knowledge of poetry provided by writers and critics, and to 
Hevercleariveiiaming, Gerctcain adeals of Sensitive and macure 
poetry reading. However, without knowledge of the actual 


transaction between a poem and its reader, teachers can hardly 


ai, Pee Ole co, mig accacad Cri lorem sNews York: 
Harcourt, race, 19299. 
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hope to be effective in leading their students toward a 
greater sensitivity to literary language and hence toward a 
deeper enjoyment of literature. 

The need for objective research in reader response 
to literature is clearly stated by Ogden and Richards in 
The Meaning of Meaning: 

The person actually interpreting a sign is not well 
placed for observing what is happening. We should 
develop our theory from observation of other people, and 
only admit evidence drawn from introspection when we 

-know how to appraise it. . . . Those who allow beyond 
question that there are people like themselves also 
interpreting signs and open to study should not find it 
Gag ttcuLe eto admity that thelr observation of the 
behaviour of others may provide at least a framework 
within which their own introspection, that special and 
deceptive case, may be fitted.1l 

At present among leading authcrities in the teaching 
of high school English there is widespread agreement that 
although one of the most complex problems in the teaching of 
English concerns the ways in which students comprehend 
literature while they eel yo the classroom teacher continues 
to suffer from a dearth of systematic knowledce about this 
process. Gunderson states that the teacher of English gets 


Littie direct help from research in learning how to teach 


his students to become skilled readers of iverscare,- and 


oe ee OddeneanGria A. ehachards, The Meaning ot 
Meaning (New York: Harcourt, Brace, LODO eae. aeoe 


2poris GundemsonpwinesPretace tolJ.,G, Squire, sihe 
Responses of peg ee While Reading Four Snort Stories 
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in the same vein, Squire has recently remarked that "empiri- 
Gal research thas «not pcontributed, notably toe.coun under 
standing of the processes and procedures involved in 
literary education." 
Ciosely allied to this problem of a lack of detailed 

knowledge about what Rosenblatt terms "the transaction" 
between a reader and a literary work? ang, largely contribu 
tory to it is the problem of'a shortage of valid and 
reliable instrumentation with which to investigate reader 
reaction to’ iiterature. |) As Squire points out, “Until better 
ways Of assessing response are available, we are not likely 
to stimulate many valuable and useful studies of the 
teaching and learning of literature."? Gunderson, equally 
concerned with this problem of inadequate instrumentation, 
says, "When .. . we attempt to measure comprehension, we 
seem forced to simplify the content of materiai to be read 
so that we probably fail to get a measure of the individ- 
Gale seCapacaty CO) COMPLenendeLulLly lle ehnat the eautner 
envisioned."* And an even stronger statement of this view 
is made by Broening: 

There is urgent need for sharper instruments for 


measuring the totality that.is literary appreciation. 
New objective tests are required to diagnose the cause 


tcguire, The Responses of Adolescents, p. 56. 


zr ouise M. Rosenblatt, "The Acid Test for Literature 
Teachingeeeeic.u si Jlounhak,, nov \Pebruany 7 906 7, A50. 
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or causes of a student's failure to appreciate litera- 
ture appropriate to his level of intellectual and 
emotional maturity. Objectively determined criteria 
should be developed to evaluate what is read, how it is 
read, and what lasting impressions (provocative ideas, 
insights into motivation, enjoyment of verbal imagery, 
and appreciation of the power of language) remain with 
the reader.: | 
The above comments refer to the twin problems of 
inadequate knowledge of student response and inadequate 
instrumentation for obtaining such knowledge as they relate 
generally to-cver ceaching Of literatures. There 1s Strong 
evidence that these problems become still more acute in 
respect to the teaching of poetry because of the relative 
complexity of poetic response. Richards, one of the first 
scholars to attack these difficulties in a systematic way, 
Vee cesmine tactical Chivictomeriat d Celllal purpose OF 
his investigation was to advance the field of science, 
with its precision of measurement, into the field of 


poate y. “Hyman, an d1lScussing “Rnicharas™ “contributions to 


the criticism and teaching of literature, observes that 


Pe Ler orocau CONtEMbUuUctOn One race ieCaleeCliGlC rom, 
ands OL RIChards™ WOrk on General ~ 2. 1S, ChicirLly one 
of method and methodology. .. . By creating some 


approximation of experimental conditions, he achieves 
FOor=therrtwrst time an Obj JeEctive, account Of Now 

poctry is actually read, and focuses attention on its 
least adequately handled area, .. . the poem-reader 
relaeronship. + 


angela Broening, "The Development of Taste in 
Morteractre (neche: Genior High School," ian N- By Smith) (ed:)), 
Phe Development of Taste in Literature (Champaign, Ill.: 
NeG.r.E.ewi063) pa pws. 
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Abbott and Trabue as long ago as 1923 were similarly 
concerned with the need for measures of response to poetry 
that would go beyond the mere acquisition of "a body of 
information, including information regarding conventional 
Gyiticaliopinionm. oF : oe They saw the need for instruments 
by means of which "light would be thrown on the degree of 
success attained in developing the power to appreciate 
2). )-;) andmbyamcans Jol “which: Yomething might eoe learned 
of the general psychological response to the stimuli of 
thesanrt) intquestion; wand lsc, fof ethe fundamentalprincipiles 
of the art itself considered as a social activity designed 
to evoke popular response." 

Loban, writing in 1947, is concerned about the 
inadequacy of instrumentation for measuring "growth in the 
Stugy O1Punteracture, saeasckLivang ethas inadequacy achietly to 
the inherent coinplexity of literature itself. He quotes 
Smiths statement that 

The development of educational measurement depends as 
much upon the nature of the phenomena with which it is 
concerned as upon the capacity of men to devise experi- 


mentallprocedures. For, as Aristotle observed long ago, 
we should not expect a greater degree of exactitude than 


lien PDbette sone Mek. lrabue,. A Measure Of Abilicy 
to Judge Poetry (New York: Teachers College, Columbia, 


Dna Versi iy alo a ap cme). 
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the subject-matter will permit. We know the kind of 
subject-matter which measurement demands, but we do not 
know, nor can we ascertain, apart from experimental work, 
whether a given subject-matter has the systematic 
character required by measurement.1 
Because poetic language tends to be the most complex and 
intensified form of literary language, Loban's comment, while 
intended for literature as a whole, applies with double force 
CORCOCEEY . 
tronically, 1 isthe very complexity of poetic 
language which has at the same time created for the English 
teacher a pressing need for more exact knowledge of the 
nature of student response to poetry and discouraged the 
kind of experimental work which might alleviate this need. 
Probably for the same reason, recent response studies, such 


: deal with fiction, not poetry. 


as Squire's and Wilson's, 
The centrai_assumption underlying this study is that 
approaches and techniques for the teaching of poetry must be 
determined not only by the nature of poetry and the reasons 
for teaching 10, but also by the way the student actually 
responds, topic. “Lewis sotGtenough for the teacher (to know 
how he wishes the student to respond; at any given stage in 
the student's development, he must know how the student in 
fact does respond. Only with this knowledge can he hope to 


IWwalter Ovi ee ValUatang Growl Gan the) Study ef 
Literature," English Journal, XXXIV (November, Oe) ey Ol. 


2 James ReeWwalson, Responses of College Freshmen, to 
iomee Novel Ssea(Cnamparon, 1 liseeN Cel sae, 1966) Fr. 
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help students move toward a richer and more refined experi- 


ence. 
STATEMENT OF THE PROBLEM 


The object of this study was to investigate the 
response of high school students to poetic language and to 
examine the usefulness of a procedure developed for measuring 
this response. The study scught to determine the kinds of 
information which could be supplied by an experimental 
peetcy Cestl cops mructedmonethempruneip |] esotmumarcching 
individual words and expressions to the context of whole 
poems and supplemented by follow-up interviews based on 
responses to test items. The study attempted to identify 
and describe various components of student response to 
poetic language and to investigate relationships among these 
components. In addition, the study examined the relation- 
ship between response to various components of poetic 
language, as measured by the experimental poetry test, and 
Pesponse 1Ony das CunsaVes lenguage ac medsuned by vayStans 
dardized reading test. Finally, the study attempted to 
determine relationships between grade level, sex, and reading 
level (as measured by a standardized reading test) and 


response to poetic language. 
DEFINITION OF TERMS 


Before stating the problem more fully by setting 


forth specific questions and hypotheses, it is necessary for 
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the sake of clarity to define the more important terms used 
in the study. 

1.) Poetry, Test refers’ to the multiple-choice test 
constructed, by, the: wrisenifionm thisistudy. 

2. Test Form refers to the two parallel forms of 
the Poetry Test, Form A and Form B, consisting of sixteen 
items each. 

3. Reading Test refers to the Nelson-Denny 
Standardized Reading Test, Form A. 

A. Holdlowrup iminterviilew refers: ‘to the iten: interviews 
which were based on responses to the Poetry Test. 

Dama lLegonites: and Subtests sefer to the four major 


Givisions consisting of four items each, which comprise the 


Poetuymest. | whese’ categoriesiiare: » i.s) Thought 
2. Suggestion 
S aero Ound 
4, Rhythm 
6. Skill in Response to Poetic Lanquage refers to 
what is measured by the Poetry Test. (This term was used 


Bathe Lhanesich terms as Jepprediation., “lpecerpretive 


apiiity , “taste”, and "Sensitivity to language” because it 
is less ambiguous denotatively and more neutrai connotatively 
than these other terms.) 

7.) Poetic Language, ‘or Imaginative Language win ats 
most intensified form, refers to the operation of words in 
epOCii LOepLOCUuCe ardistinclively poetic meaning. It does 


Mote Lele fo apspecia. ized) poetic diction Dutwus «characters 


iged by its suggestive quality and its emotive effects. 


a snail 9 on. paniot sg “, 
_ 7 
Amives @ins 12% ei mee 


" ‘Reuamack Ganhe tes aupoed? oF Saute | Saaeeal oy | 


- : wenn PachasweltAre 4 535 is we EBSY Ve 


nies yassnghken: gti dd cies See patie oo 
fend. pc eea® Ses 


Ss te POS e ned GMD G2 PP sokY YO yyaiay stiawy L292 « 


ie 
S 
f 
Cc 


a aap eget 
a Dv ¢ ey kee 
% ee <> 


soem) qpmh ers wr testes eth eye 6H aaj nag: 
mere WEEP ir= sa, sae , ie) ° ; »*"o et 222 20reo - i 
| ‘ Pal Paya”) i e9350 G60? dec -vReaee 
r * aa ry —aa 
Baldeeveda =: ; 
= - + Dat a Fe ; 


een > 
= - ; - “. c 
i F309 ° Pre > Pw e2ee 12 at. ae fjes2@ «.B 
— ie an <= _ - ee ee : 7) ts . 
be aaers aia wie? G4 iS ‘e0'f “0 ef Surpeses ahs rent 
: * : = 
wrk saaguets 5® “anbatioemc.s’ 25 eee Bove ae 


st ees74300 Sepaurta O27 3 au At i“ res “apie” oY 


Ulevitaonaant Saree: Saupe, kn » wen3D sion iam. 


i, 


a 


8. Discursive Language, used in opposition to 
Imaginative and Poetic Language, refers to verbal expression 
which is primarily referential or denotative, and is more 
concerned with the communication of ideas than of feelings. 

9. Imaginative Language refers to language intended 
to arouse the imagination and emotions of the reader or 
listener. It attempts to cause him to recreate the original 
aesthetic experience of theliwriter, and isnot primarily 
concerned with conveying fixed meanings. 

10. Response refers to the active recreation of 
meaning arising from the interaction between a reader anda 
literary work. 

11. Thought, or Denotative Meaning, refers to what 
is measured by Subtest One. It is substantially the same as 
Whatehichardsecaiiicnthe =thought”"sor "sense"* of a poem, and 
could be described as the "paraphrasable meaning" or “para- 
phrasable content" of a poem. 

12. Suggestion refers to what is measured by Subtest 
Two. It is the meaning produced by the distinctive opera- 
tions of the formal elements of poetic languace, such as 
metaphor and imagery. For the purpose of this study, it 
does not include the effects created by the sound values and 
rhythms of words and groups of words. 


nee Sound denotes what is measured by Subtest Three. 


1s, PerekuchaLasparnacticaliGriticiem, pp. 275, 200, 


o0G. 
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Por "the purposes Yor this®study aterefersitorethesoperation of 
segmental phonemes only and does not refer to rhythms and 
SBELESS Patterns,’ = Sound) ease virtual yeallwauthoriiiess point 
out; rerely produces meaning independently: 9 it typically 
aGrs Ineconrgumction withiehe connotative or associational 
Values of*words. Hence Subtest Three consists of items in 
which sound was considered to make a significant contribu- 
eron CO chestotal Mmoanings Gatherethansitems purport img. to 
measure sound independently. 

14. Rhythm refers to what is measured by Subtest 
Four. Rhythm was chosen rather than metre because, although 
most ofethe chythm items anvoilvet metre, some?’ do not. in 
certain of the rhythm items, for example, some of the 
alternatives are not metrical, while in others the metre 
has merely been changed so as to accord to a greater or 
lesser degree with the prevailing metrical pattern of the 
poem. 

15. The names denoting certain formal elements of 
POCLLC langage, "such asmaLmageLry, Mave. been Secs DyMerUuLI CS 
and educators with a certain amount of ambiguity. For the 
puLpeses Gmtivss "Study = Eneretoue: 

(a) Metaphor refers ‘to all “poetic comparisons, 
whether cdarectly stated, as in the case of similes and 
metonymy, or implied, ass in@the ‘case ol symbolism: 

(b) Connotation PeLrers "EO StheruseMoL words tor their 
suggestive, evocative, or associative powers. 


(c) Imagery refers to the use of a word for its 
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powers of sensuous suggestion, whether visual, auditory, 
Gisactopy, romttacti lex 

(d) Ambiguity refers to the deliberate exploitation 
of the multiple denotative and connotative meanings of words 
and expressions. 

16. Formal Elements, or Poetic Elements, 1s used in 
this study to refer to the various technical devices, used 
most consistently efandycharacteristicakly win (poetry , waich 
distinguish imaginative from discursive language. These 
include such devices as imagery, metre, irony, ambiguity, 
and metaphor. 

17. Dimension refers in this study to the components 
of skilljin reading poetic language whichesare measured by 
tnemsoun subtests: 

he “hatitonalizeation, reters in thas study to the 
conscious awareness of the operation of the various formal 
elements of poetic language. The level of this awareness 
Ganiwvacy frit might be low during the actual’ reading of a 
poem, and high when the poem 1S considered in retrospect. 

NOE el eonou Rational Zot uormneie cei Liisestudy 
to the extent to which a given act of sSeiection: can be 
Mec ed pLorougiieto alconccicus tevel, andycoherently 
explained. 

20% Qualieysol Rationalizatrongretéens inetaiststudy 
(a) sto=thesdegree of ‘similarity between reasons actually 
underlying the original selection and reasons given later 


andm(byetosthermextenteto which these, onieginel reasons 
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approximate those which might be expected from a highly 
qualified reader of poetry. 
Jie  COLrect, 1S"useq im Chapter Vv towrerer to tie 


keyed response, which is the alternative taken from the 


original form of the poem. 
QUESTIONS AND HYPOTHESES 


The problem which th2 study seeks to investigate 
Hayle —staLlLea= tore, Spetliicatay an terms Of certain 


questions and hypotheses: 


Questions Relating to the Performance 


of the Poetry Test 


1. How reliable is the Poetry Test as a whole in 
terms of its purpose and in view of what it attempts to 
measures 

2. How Similar are the two test forms? Are they 
StaLasticamiy equivalentrs If hot, can they. be considered 
comparable? 

Bee els the ditricuity Level™ or the test appropriate 
COMmtneeorour LOM whlch It 1s to be acministerede Does Lt 
appear to be relatively more appropriate for the Grade XII 
CLOuUpsOu Nem Garaae™= A. GLOUD. 

4, What is the degree of correlation among scores 
on the four subtests? To what extent do they wappear. to 
measure discrete skilis? 

See Wilite patter nssOtecOrLespOondence, li eany, mec se 


among performance levels on the four subtests of ‘the Poetry 
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Mest els —chere,. for example, a, closer correspondence 
between performance on Subtests One and Two than there is 
between Subtests One and Three? Between performance Sub- 
tests Three and Four than between Subtests Two and Three? 
How does grade level affect these correspondence patterns? 
6. How does performance on the four Poetry Test 
subtests correspond with performance on the Reading Test? 
is this, coreespondence, greater for .some Poetry, Subtests. than 
for others? sow, does grade level .atfect this .conrespondence? 
7. Can the testing technique used in the Poetry 
Test provide reasonably detailed information about the 
response to various elements of poetic language? Is it 
capable of measuring response to an adequately wide range 
of elements and in measuring this response at different 
levels of sophistication? 


bypouneses Relating to the) Performance 
by .Classesvot Individuals 


1. There is no significant difference between the 
mean performance of Grade X students and the mean performance 
Om Grade SLL students on Form Avand Form B of the Poetry 
eos 

2. There is no Significant difference between, the 
mean performance of boys and the mean performance of girls 


for both grade levels and hoth test forms. 


Ge, Therese novsigniticant ditlerence between the 


mean performance on Form A and Form B of the Poetry Test 
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Caverecepacare yeorestudents In thesropethi ta, @midale shard, 
and bottom third according to Reading Test scores at the 


Grade X level and the Grade XII level. 


Questions Relating to Factors in 


Response to Poetic Language 
bee DOese@thespatternsore tactormioadingssonre the 
various Poetry Test items indicate the presence of a number 
of interpretable factors in the response to poetic language? 
2. To what extent can these factors be identified 
and described? 
Ow BLOWReO@theserilactons relate to other findings 


produced by this study, especially the interview results? 


Questions Relating 16) Interview Results 

i. To what extent are: students generally able to 
account for selections made while responding to the Poetry 
Leste 

2. Are students who make high scores on the Poetry 
Test better able to account for their choices than students 
who make low scores? 

3. Do different students appear to use different 
strategies of thinking in the way they attack the various 
items? 

ee Are Studenie better able to waccount for selec— 
tions Within items from some of the subtests than for 
selections within items from other subtests? 


5.) How stable are the test, items) 1.6., ow 
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accurately are students able to recall the selections made? 

Chegoreceilemestabi lity, and tLestactabilitveacwa 
whole, related to proficiency in answering the. Poetry Test 
items? 

foes Wnat isethe rolesofscontext, inathe making<of the 
selections? Does this role differ among the different, kinds 
of items,,.i.e., among items from the different subtests? 

8. To what extent are interview results related to 
Poe sbesith Sip O0ucec. byslaGteCrmanalysSicas JO what extent do 


the interviews lend support to factors which have been 


identified and described? 
DISIKEIN Ole Weis SAMuIDNE 


In order to investigate the above questions and 
hypotheses an investigative procedure consisting primarily 
of an experimental poetry test was developed. This test 
classified poetic language under four categories designatea 
Ao OUGHt ey A OUdGSSt LON Sew oOUNG y, aidw hn ye mia aL WO 
forms, Cach comprising 16 items, four in each category or 
subtest, were developed. The testing procedure involved 
presenting the student with a whole short poem, or reason- 
aplveinredrals section of aslangenspocn, i comeynich sa.word 
or phrase had been deleted, and requiring him:to select the 
original word or phrase from four alternatives using "clues" 
Econmethe .context.. 

Supplementary to the poetry test itself, a follow-up 


interview programme was developed. Essentially, the 
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interviews were structured in order to require students to 
explain their selections within the various test items, but 
provision was also made for a certain measure of free 
response. 

PNneSelCSesitems, -aLterecontentevallaatroneby sfoun 
yuages>; —weresuscdvineavnumbersofepalot studies sovasiito 
obtain optimal difficulty levels and a high degree of 
discriminating power for each item. The interview schedule 
Wasa toOmcoocteam oye MeanceOt ras plLOtestugy.. 

The resulting two forms of the poetry test were then 
administered in conjunction with the Nelson-Denny Reading 
Test, Form A, to eight classes of high school students in 
NoOLeieVoncovuver;, Bw CyyplouceLrom. Grades, anderourvitronm 
Grade XII. These classes, consisting of 191 students 
taking the academic programme, were selected at random from 
a population of ;approximately 80 classes and 2400 students. 
Within seven days following the administration of the Poetry 
Test, interviews were conducted with a representative sub- 
sample of ten students. 

In order to examine the reliability of the poetry 
test and to determine its usefulness in providing information 
about various aspects of students' response to poetic 
language, test results were subjected to item analysis. 
tere onee ators were obtained for the Poetry Test totals 
anassubtotals andthe’ Reading Test totaisviand)subtotais. To 
compare relationships between grade level, sex, and reading 


level and Poetry Test performance two-way analyses of 
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Vablance were Carried outa principal components factor 
analysis was performed on Poetry Test results in an effort 
Lorexamine the underlying factor structure of poetic 
language. 

In addition, the recorded interviews were analyzed 
in order to obtain information about students' thought 
processes while reading poetic language which would supple- 


ment the results of the statistical analyses of test data. 
DEBIMITATIONS, OF THE STUDY 


eeiieavtew Creiielimprobabll ivy. of obtainingea 
valid measure of affective response to poetic language 
through a pencil-and-paper test, the Poetry Test purports 
to measure directly only cognitive aspects of response. 
"Appreciation" 1S examined only indirectly. 

2. The Poetry Test emphasizes skill in responding 
to poetic language rather than skill in deriving a global 
meaning from a whole poem. 

3. The design of the experimental test required the 
reduction of a large number of poetic elements into a 
relatively small»numbervoteicategories (four). Therefore, 
the study does not attempt to measure equally all important 
aspects of response to poetic language. 

ne The sample of subjects was taken from a popula- 
tion of Grade X and Grade XII students. The findings, 
therefore, may have only limited application to other 


educational levels. 
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LIMITATIONS OF THE STUDY 


i the small numbersor items (four) within each 
category, or subtest, which was made necessary by the test 
design, limes the *generalizabl lity of conclusions arising 
from responses to any one of the subtests. 

2. Because the Poetry Test was not a one-factor 
test, because a test-retest procedure was not feasible, and 
because it was not possible to administer both test forms 
GOmUNemSanlewsubyects, Onlyealpartial teliability can, be 
demonstrated for the present test. 

3. As the interviews were conducted by the experi- 
menter, responses relating to individual items were possibly 
subject to distortion due to the interviewer's expectations. 

4. The interview results were dependent on such 
factors as the student's ability to recall thought processes 
and the student's verbal fluency. Because of problems in 
establishing credibility and in detecting spurious 
rationalization, the interview results need to be inter- 


preted with caution. 
SIGNIFICANCE OF THE STUDY 


As was reported earlier there is general agreement 
among authorities im the teaching of English that the more 
effective teaching of poetry entails showing students how 
fOsacri verieaningertom Wpoctic!™ “asmopposed Co “discucsive © 


language. The teaching of poetry can be regarded as the 
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teaching Of a special kind of reading skill requiring on the 
parteorPthesteacher®accuratetinirormation about the way 
Students respond’ tosthe language™or poetry. = "Lhist®kind of 
information is lacking largely because of a serious lack of 
the kind of instrumentation which reveals the underlying 
factors in response to poetic language and which provides 
objective knowledge about a student's thought processes as 
he reads a poem. 

The present study accordingly attempts to develop 
and@assessethe valuecrol  avspecitiic = procedure=for investi-— 
gating student response to poetic language. At the same time 
the study attempts by means of this procedure to throw light 
6n some Of Sthe factors “underlying this response.) It is 
hoped not so much that definitive conclusions will be 
reached but that the investigative procedure used will 
stimulate other and perhaps more sharply focused research 


into student response to poetic language. 
PLAN OF THE STUDY 


Chapter II presents a review of related literature. 
First an examination of statements by critics and educators 
regarding the nature Of poetic language is presented. This 
is followed by a review of statements regarding the testing 
OG literature in general, the measurement of student 
response to literature, and the measurement of student 
response to poetry in particular. 


Chapter Ill Sets out the research design for the 
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study. In it are described the development of the experi- 
mental poetry test and the interviewing procedure, the 
sampling procedure and collection of data, and the statisti- 
cal treatment of the data. 

Chapter IV presents the results and interpretation 
of the statistical analysis and the discussion of these 
results. 

Chapter V presents the findings derived from the 
interviews, together with a discussion of these findings 
as they relate to the results reported in chapter IV. 

Chapter VI contains a summary of the main findings 
ot the study, generalizations “esulting from the, study, 
suggestions for further investigation, and certain implica- 


tions> for, thes teachingwand testang,ofs poetry. 
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CHAPTER II 
SURVEY OF RELATED LITERATURE 
INTRODUCTION 


Following upon the basic assumption that the 
primary emphasis in the teaching of poetry must be on the 
student's ability to respond adequately to the language of 
poetry, the present chapter is mainly devoted to examining 
the nature of poetic language. 

Because of a lack of empirical investigation there 
is a current shortage of systematic, objective information 
about a student's thought processes as he reads a poem. 
Thus knowledge of the difficulties likely to be encountered 
by a high school student in reading a poem must for the 
greater part be inferred from what has been written by 
artists and scholars about the characteristics of poetry 
and poetic language. This review accordingly deals mainly 
wrth the writings of poets, critics, literary theorists, 
and authorities in the teaching of literature. 

Because the construction of an objective test forms 
a major part of the study reference is made to the testing 
osm eeavecire with special emphasis on the testing of 
poetry. Also examined are studies of student response to 
literature in general and to poetry in particular. 
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THE NATURE OF POETIC LANGUAGE 


The main purpose of this section is to review 
certain commonly agreed-upon features of poetic language 
which distinguish it from discursive language and which 
aio MOsteltRely LOPaAccOUnte  torad Student. S cditticulties in 
reading a poem. The term "poetic language", as used here, 
is to a large extent synonymous with "imaginative language" 
and the essential distinction is between "poetic" and 
"discursive" language. 

Generally speaking the reader's difficulties stem 
from two sources: first, the inherent complexity of poetic 
language, with its many dimensions of meaning, and second, 
the difference between the ways in which poetic and 
discursive language embody and transmit meaning. 

Both this inherent complexity and this difference 
are due mainly to what linguists term the "hypersemanti- 
Gisedtwaspecu Of DOEtIC Language, 1.6.5 10S Capacicy to 
convey meanings over and above those connected with normal 
syntactic and semantic rules. These extraordinary meanings 
Teste irs, cLrom the poet's concern with’ the total 
Meaning OL a word. Unlike the writer of a scientitic 
report the poet is concerned with a word's sensuous 
qualities, its evocative power, and its sounds. 

Second, poetic meanings result from the organic unity 
of a poem, by which is meant not only that structural elements 


act interdependently in a poem to produce meaning but also 
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25 
that in a very real sense these structural elements eerie 
meaning. Even in strictly denotative language words tend 
to have a number of possible meanings, and as a rule the 
GEcavem sche spoosss bilities for vambiguity, the oreater the 
MMNpOStanCe eOreCOnLext singguiding the readen or Listener in 
choosing among these possible meanings. In poetry, with 
its many types of meaning, this process of selection 
becomes stili more demanding and complex. Hence in poetic 
Hanguage SeGewero..e of pcontext is sof maximum importance. In 
poetry the bond between one word and all the other words of 
a poem is stronger and consists cf more strands than the 
corresponding bond in discursive language. This intimate 
and complex bonding is essentially what is meant by "the 
Ocdanie sUNLEy 4 1Ol AwpOen. 

Accordingly, this section reviews critical state- 
Mentesepemealning,to characteristics of poetic, .or “imagina~ 
tive’) language which distinguish i1t,from discursive 
language. Examined first are general characteristics, 
suchwaspthem Organic unity” of spoctic.lancuage and the 
Multcaplicity of meanings.found.in poetry. This is followed 
by a more detailed examination of poetic language as it 
Polceo Momence natnescoucLuraiy Clements OLepOctrys Connota— 
tion, metaphor, imagery, and sound. Although there is some 
unavoidable overlap between the first, more general, and 
the second, more detailed, review, each treats poetic 


language from a different perspective. 
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Generali Characteristics of Poetic Language 

An@examinatlon®orsbngiashtditerary criticism for 
views on the general nature of poetic language reveals two 
focal figures, Pope and Coleridge. Pope, reflecting the 
Horatian, or neo-classical tradition, and less directly the 
classical view that art is an imitation of persisting, 
objective forms in nature, sees poetic style as related to 
but still separable from the matter of the poem. For him 
poetic language is "the dress of thought",+ with the sound 
"echoing the sense". For him language as it operates in 
a poem is essentially an extension and refinement of dis- 
cursive language. The poet by means of his special skill 
with words merely expresses a meaning or reality which is 
external to the poem. 

Coleridge on the other hand sees the matter of a 
poem as living only in its words and as non-existent apart 
from its language. In Coleridge's view the function of 
art is to imitate nature not by merely imitating the con- 
GruetespaLtrciulars Chetneenalurailewould Orweven Goreugh 
selection among these particulars to reveal universal forms. 
What art seeks to imitate rather is the process in nature 
through which concrete particulars and universal forms 
foultileeach) OLher and exist only through one another. The 
creation op a work of art is a re-enactment of this process, 
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antincarnation of reality." Hence® in’ a’ poem the! reality 
which®concerns = poet) critic,Pandereader alike exists in the 
interaction between the concrete particular and the overall 
form-—-between the whole and its parts. Thus the poem, 
according to Coleridge's view, is conceived of as an 
organic unity where the whole is far more complex than 
SHeeSumeEoriats pactsle Threough@emultevew i hort Uaelusionete 
force many into one",+ a poem duplicates the active 
principlesottnatures 

This well-known Coleridgean view has been presented 
at some length because generally speaking it underlies most 
of the currently prevailing ideas on the operation of 
language in a poem. The influence of Coleridge can easily 
be traced through Richards and the "New Critics" to most of 
the current works on the nature and the teaching of poetry. 

The following description of general characteristics 
of poetic language therefore istclosely’ related to the 
Coleridgean view. Each of the characteristics is in fact 
merely a facet of the overall idea of "organic unity". 


Accordingliy Chesexcharacteristics are closely related. 


Organiceuni ty . According to ethesGoleridgean views, 
the meaning of a poem is produced by a harmonious involve- 
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interaction among all the various elements that the meaning 
resides and just as the poet re-creates, or "abridges",- 
real utynbydimitating tthe activesprocessrofr natureyvanewhich 

thes unmiversalsandSthetparticularerulriiW each other tthe 
Yeaderypin turn, is actively “involved in the re-creation of 
reality, duping wthe ract fof treading. OlOnly GLanoughwthis “ne-crea- 
tion of reality can the reader derive meaning from the poem. 

Thus, in poetic, as opposed to discursive language, 
the meaning of a word or expression or the effect of any 
one structural element is far more closely dependent on 
GOnvext anduicnresmeaning ChLOnecepanters moreeimtcimately 
eonnected with the meanings of all the other parts, both 
separately and in combination. 

Most modern critics, perhaps because of the influ- 
ENGesOrel. Sa Richards, (tend seOolecho Coleridge in. thus 
MacleereOL OLdalwec unLty.. it as commonly xecognizedsthat 
the more successful a work of art the more its substance 
becomes inseparable from its form. Ciardi, in How Does a 
Froem Mean? notes: 

For What Does a Poem Mean? is too often a self- 
GeseEroying approach to poetry. “Avmore useful way of 
asking the question is How Does a Poem Mean? Why does 

at bulla 1tselt into aacormi-oue,.of-—aumages, ideas, rhythms. 
How do these elements become the meaning? How are they 
inseparable from the meaning? As Yeats wrote, "O body 
swayed to music, O quickening glance/How shall I tell 


thercancererrom tie dances What a poem is; as 
inseparable from its own performance of itself 2 
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coon Ciardi, How Does a Poem Mean (Boston: 
POughtone Matt Dinyee 9 50) pn Obs. 
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ingmuchithetsame tvein ptDattzespeaks: of a poemyasila whole 
made up of many parts with “each word . .. entangled in 
the meaning, suggestion, feeling, imagery, and rhythm of 
the whole,"* Ssostnattne wlenguagetakesroni rats ignags cance 
far beyond its dictionary meaning. 

Also subscribing to this Coleridgean view of the 
whole being a harmonious involvement of all of the parts 
are such writers as Bheniy i Gurrey,° Gate Richards;- 


Seottme and Murphy. / 


R. P. Warren's statement that 
‘Poetry does not inhere in any particular element but 
depends upon the set of relationships, the structure, which 


we call the poem"® is perhaps the most succinct comment on 


this whole matter, not only of the unity of form and 
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“philip H. Phenix, Realms of Meaning (New York: 
Mecraw=Hnitll, 1904), Dp. 17S. 


om Gurrey, The Appreciation of Poetry (London: 
OraorOmuUlevers Way DLE Ses 955) DD eo oo. 


4 ans Guth, English Today and Tomorrow (Englewood 
GittEs eee Loulice-Hall,el964) ye pp. eco os. 


ik, A. Richards, Practical Criticism (New York: 
Mase OULU ab a Cy OO) eu) el ole 2.04 


Cwilbur Scott wllve AporoOdchesa lo wulterary CEreLoism 
(New York: MacMillan, 1963), passim. 
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OR: P. Warren, Selected Essays (New York: Random 
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content but of the interdependence of the formal elements 
themselves. 

Because of the close interdependence of structural 
elements and of individual words and phrases which "organic 
unity" implies, the meaning of a poem can emerge only from 
a rapid and constant shifting of the reader's attention 


among its various parts. Coleridge speaks of the need for 


iy 


ee eecie perpetual tend distinct a Eventi onto) cach part, 


and notes that poetic, as opposed to discursive language, 
Fis oiscrimimated= bys proposing tol itself such delightitrom 
the whole as is compatible with a distinct gratification 
from each component part." 

The difficulty for the student in this matter is 
that he is habituated in his "normal" use of language to 
consider "content", or "sense", or "meaning", as something 
separate from the language which conveys it, so that when 
he approaches a poem he tends to bring a faulty set of 
expectations as to the kind of meaning he shculd be looking 
for. If, with Pope, he sees poetic expression as merely 
"the dress of thought", i.e., as merely a refined version 
of discursive language, and attempts to extract meaning 
from words and expressions using only standard syntactic 


and lexical rules and neglecting the "distinct and 


Dales, 5 Ciera we STAs: 


“Thid. 


7.) .de ee 


a 7s - ; 
. 7 — 
Aa b aaidaiele cegns “ 


i 7 ee 
ot 
7 a > 
. J Gan Ofer bee [Tt as 
 saansoue- « o “ 74 =) 
Ss ot | . 
7 Te ert hans 
gliagpte® duias mare in Te : 
mt 4 
eure" Eu 54 5 fie y, \ 4 
we >$ 433 i L * 
re 
* >| (a ” ‘ 
: : j S 
: ¢ = : 7 * @% 
her » itt es 
. a a be | LN | 
Pr ¢ i . 
e <1 4 * “ap ee | ij i j 2 F al 3 
« =} - a’ ‘ ’ A 4 oa? 
1 ‘yn2 he) 
sl 
4 4 A 
- 
) nf 
aw. OU « : 1 
Lanne i 
o- . 
is craev err) a > oe q ' iw 
; t 
tA clean Dats ase ine 
gktracr) ’ BIehe yi tw ¥ -_. 2 
> 


7; 


29 


perpetual attention" to the relation between each part and 
its context’ required by poetic language, he is likely to be 
baffled and disconcerted. What he fails to realize of 
course is that a poem, as an organic unity, demands his 
ACTIVE participation “and cannot be *treatedsas an "artful ly 
constructed or cleverly embroidered piece of discursive 
writing, expressing "what oft was thought, but ne'er so 
well expressed. "* According to the Coleridgean view, which 
is essentially the one currently prevailing, the reader of 
a poem must be actively engaged in the creation of meaning, 
not through imposing his own abstractions on the poem, but 
by using his experience to allow him to perceive universal 


forms emerging through its concrete symbols. 


Plutdacy on Meaning sASeidcmoeen melted above the 
notion of organic unity implies a close interrelationship 
between the words and structural elements of a poem, with 
the meaning of each part being far more dependent on its 
context than is the case in discursive language. An 
obvious corollary is the notion that words and expressions 
as they operate in poems tend to have fluid rather than 
fixed meanings. 

In recent years linguists and psychologists have 
pointed out what many writers and critics have known all 


along, i.e., that word meanings are not fixed and static, 
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Lo bemlearned once: and! fonvalleandraccumulated anithesmind, 
DUutMaLrest OLeverimodiiaediiby Rhemcontextilinswhichy theysare 
used and by the level of awareness of the individuals using 
the language. 

Vygotsky defines the "Sense" of a word as "the sum 
of all the psychological events aroused in our consciousness 
by a word" and describes it as "a dynamic, moving and 


ih 
complex whole." 


According to Vygotsky, "meaning", unlike 
"sense", is "only one of the zones of that sense which is 
acquired by the word in the context of speech, namely, the 
most stable, unified, and precise zone."* Vygotsky's view 
that word meanings develop, both in the consciousness of 
individuals and in the consciousness of the race, is of 
fundamental significance in understanding the nature of 
poetic language. His theory makes it possible to conceive 
of poetic language not, as many linguists have done, as an 
aberration from normal language, but as a phenomenon which 
relates to two fundamental, opposed, and complementary 
human needs. These are the need for the development of 
individual consciousness and the need for social inter- 
course. “Vygotsky sees in the course of the historical 


development of language "the structure itself and the 


psychological nature of meaning" changing in the direction 
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of greater, generalization and abstraction in the expression 
of ideas. At the same time he sees as developing in the 
child something he calls "inner speech" in which "the 
semantic, aspect develops from the whole to the particular, 


tb 
Fron Sentence, to, word. 


It would seem that paralleling 
this process within the child and in opposition to the move- 
ment of language toward greater abstraction is the poetic 
use Of language, where the direction is toward concreteness 
ands particusarity. 

This fundamental opposition between language as 
transmitter of meaning (discursive language) and language as 
creator of meaning (poetic ianguage) has been noted by other 
psychologists and by many linguists, semanticists, and 
literary critics. Barfield sees the main function of poetry 
as either the creation of new meanings or the recreation of 
lost meanings, "pointing up the resemblances between 


2 J . J . . > . ’ 
Richards,) who an his» carlirer writingssdastin- 


Ehningses 
guished between "emotive" and "referential" language, later 
came to see a more useful distinction as between "rigid" and 
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meanings but leaves them fluid, which does not fix an 
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prose and factual discourse must. It leaves them free 
to move about and relate themselves in various respects 
to one another.1l 

Ullman, while noting that there is usually a hard 
core of meaning which is relatively stable in a word, and 
which can only be modified by the context within certain 
timistts;ealso recognizes this fluidity in linguistic 
meaning, and notes that "the influence of context increases 
with possibilities of ambiguity." Because it is in poetic 
language that these possibilities of ambiguity are most 
evident, this view seems to be in complete accord with 
Bichards Pet luidsby rn ugra ity econedniuum . 

These statements all reflect an awareness of 
Linguisiicameaning as »'Gluid” j.<ons'dynamic”s -—They also 
pOInt bo the fact that ,the degree iof a iluidity,” of «a egiven 
Word aVarLes faccording.sto, the Kiindysot utterance »of which sit 
forms a part; and that words achieve their greatest degree 
of "fluidity" in poetic language. Further, these statements 
point to an awareness of two opposing forces in language 
development, both of which are necessary to human develop- 
ment. One of these, seen best in purely discursive or 
referential language, is toward fixed meanings, toward 
genera luzaisLonwandwabstraction; tehesotheujeacharacterized by 
ae A. Richards, Speculative ‘Instruments (London: 


Routledge sand Pall. L955) mips 148. 
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poetic language, is toward synthesis, toward expressing as 
much meaning as possible in a single word or expression. 

ine, objecreore che tirsmotethesesiseto: fax meaningss so.as) to 
make efficient communication possible; the object of the 
second is to create new meaning through the medium of 
language. 

Thus lit) istcleary asmBuys ssenst points out, that each 
of these two forces is necessary for the other's health and 
even survival. The artist is primarily interested in 
expression, but in time, if he is sufficiently skilled and 
his audience sufficiently responsive, he can achieve richer 
and more precise communication. Conversely a keen awareness 
of fixed rules of syntax and semantics, of the "hard core of 
meaning" to which Ullman refers, is as necessary to the 
artist creating new meanings by opposing or stretching them 
as it is to the purely discursive speaker whose scle object 
is to comply with them. 

In Chomsky's phrase, literature "makes strange" 
with language. The suggestion is that poetic meaning is 
generated through a tension between established language 
usage and the "new" mode of utterance. It would seem that 


the greater the sensitivity to the refinements of 


loric BUY SSsens, Lia Communication CUAL PATO iad te LOn 


Pinguvse tc uesurciats er resses Universitaires de France, 
LOC) Pisppae oo. 
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Noam Chomsky, Language and Mind (New York: 
Taeeehee,, Buace: andor /cyeelo6 S))rraaie. ee 3 
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established usage, the greater the possibilities for the 
production of poetic meaning. 

The preceding section has examined the relationship 
between poetic and ordinary language in terms of the notions 
Ome suurcity sand irigadaty . it Nas presented, tie notion 
of poetic language as lying at the opposite end of a 
PInGULSerC CONLTIUUM LrOm purely iscCUre1 Ve, OF KTeferential, 
eanguage peace sie NOUlOle ela tne. WOLOS Ole pOCtry. are =—iuia, 


as Opposed to rigid, in their meanings. 


Multiplicity of méamings in poetic: language. 
Closely related to the view that poetic language is charac- 
tepuzeu byl itiuiarcty OL mMeaninguicethe notion cf “multiple 
meaning’. | Perhaps’ the greatest “source of difficulty .tor 
the uninitiated reader in approaching a poem is the 
characteristic tendency of poetry to use words and expres- 
Sions to convey separate and often contradictory meanings 
Simultaneously. Empson, in his influential Seven Types of 
Ambiguity,~ sees imprecision of meaning not as a deficiency 
but as the chief virtue of poetry: he finds ambiguity the 
essential mark of poetic expression. Not only can a word 
or expression have several meanings in one dimension, such 
asutnesdenoOceti ve, dimension; it) Can valso shave one cor more 
meanings in yet another dimension. Thus, the sound of a 


word might simultaneously reinforce its denotative meaning 


william Empson, Seven Types of Ambiguity (New York: 
Medan elo Do ere beers. 
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and run counter to its connotative meaning. 

Ciardi notes that while all language is to some 
degree characterized by the simultaneous operation of 
different meanings, poetry differs from ordinary language 
in deliberately and consistently exploiting ambiguity. He 
notes that the poet simply makes his selections with 
greater attention to the various forces within the word. 

Here again the implication for the teacher of 
English literature is that the reading of poetry must be 
aneexctremely complex=process. Lt 2S in the, tendency of 
poetry to make use of multiple meanings that much of its 
power and unique value resides. If used with skill poetic 
ambiguity, as Empson shows, allows the poet to exploit the 
bull powereand subtlety of bis language. in controlling 
the relationships and tensions between the various meanings 
of a word or group of words he can express what could not 
be expressed otherwise. 

Perhaps the great value of multiple meanings is that 
they make possible the organic unity the poet is attempting 
to achieve by forcing the reader to become involved in the 
poetic process and to form his own synthesis of the total 
meaning OL a poem. In effect the reader 1s compelled to 
re-create the ieriile Harlyyestressing Chevamportancesor ihe 
transaction between poem and reader in the poetic process, 
speaks of the reader as struggling for the artist's 
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1 : 
Richards, in one of the clearest statements 


meaning." 
CbSthiCwerrectrOor multrpletmeanings, points out “that 
There 1s a productive activity between the words as we 
read, them. Following, exeloring, becoming that activity 
is, I suggest the essential thing in reading the poem. 
Understanding 10 Gs not a preparation for reading the 
poenw= Metis teseleethe poem. ~Andiei tise econstructive, 
hazardous, free creative process, a process of concep- 
tion, through which a new being is ee in the 
mind. . . . We seem to create [the] poem. 

The more demanding the synthesis, therefore, the 
greater should be the reader's involvement with the poem. 
It is not merely, as Richards' earlier work suggests, a 
case of transmitting a ready-made experience. The meaning 
is rather the set of interactions between poet and poem and 
between poem and reader. 

Another value of poetic ambiguity is that the poet, 
iMiplientpulatang the way the many kinds of meaning at his 
disposal reinforce and oppose one another, can achieve not 
only a high degree of subtlety and precision but a richness 
of meaning not possible with discursive language. At the 
same time the use of multiple meaning can produce a degree 
Of Vigour anduintensity rarely found anediscurnsive language. 
Equally important, this concentration of expression makes 


A 


possible the quality which Aristotle calls perspicuousness.~ 


Margaret Early, "Stages of Growth in Literary 
Apereciatacny | eng iach Wolunal),(OCLObem, 81960) 705647 


“n1len Tate. (ed.), The) Language or Poetry, (Princeton: 
PreiInceton sue Press) 61942) 7p. 1/6. 
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This quality, which is made possible only through the con- 
ciseness produced by multiple meanings, allows the poem to 
be) seen aS an organic: whole. 

It will be clear from the above statements that this 
tendency of words to mean several things in several ways at 
the same time is an essential characteristic of poetry and 
of the poetic process. Combined with the characteristic 
"fluidity" of peetic language discussed earlier, it produces 
the quality of suggestiveness so prized by the romantic 
poets and.critics and so. typical of modern poetry. As 
Coleridge notes, and as has been suggested in previous 
paragraphs, the power of poetry is not attained through 
detailed description but by forcing the reader's imagina- 
LON Oscreate, Lhe, picture, 

It will also be clear that the reader who approaches 
a poem expecting to find unambiguous, fixed meanings will 
experience considerable difficulty. The implication here 
for the teacher of poetry is that the main task is to make 
students aware of the way poets deliberately exploit 


ambiguity in their creation of poetic meaning. 
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there has been considerable controversy over whether the 
language of poetry differs from the language of ordinary or 
"discursive” ‘speech in kind’er merely in ®dégreey This 
study, in accordance with the broad consensus of current 
critical opinion, takes the view that a word or expression 
WS, POStTIe "NOt in Mrselrebutwin=the specialeway inewhueh 
eerS used =to convey poctic=meaningd ss ehichards ,“supporting 
His "bastcs contention that literature is essentially a 
matter of communicating experience by means of a certain 
aesthetic mode of expression, contends, as did Wordsworth 
and Coleridge, that the development of a separate, 
specialized poetic diction makes true poetic meaning 
impossible and that "poetic meaning” can exist only in 
terms of the way poetry is interpreted. As Schiller, ina 
recent xceview of Richards' contribution to criticism, 
Doints, out: 


Richards requires for his literary theory a theory of 
interpretation with which he can locate the broad con- 
trast between poetic and non-poetic interpretation, not 
a theory of meaning. He needs a commonsensical contrast 
between, cur poetic “and non—-poctic activities, . . .)) The 
writer shares his medium with all who use the language. 
ine words Ne uses are the same -as those used in every— 
day-dtscourse,. “He 165 in fact, “contaneatcoe the words 
and to the meanings of each that native speakers have 
agreed upon. There 1s 9no- 1a terary=vocanulary;, tnere 

are no "poetic" words. The writer simply makes 

ordinary words behave in extraordinary ways.t 


There is also a need to be clear about the relation- 


ship between "poetic language" and the language of literature 


oRept Schiller. sALe Richabos —heory Or guucenas 
ture (New Haven: Yale University Press, LOSE en. SAT 
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as a whole. Here again the difference is one of degree 
rather than‘of kind. Perhaps it is most useful to conceive, 
as does Murphy, of a continuum in the use of language, with 
purely discursive or referential speech at one end, lyric 
poetry at the other, and other literary genres in an inter- 
medzareaposntion.€hAccording tLotthishkview, twhichtaccords 
with the position taken by this study, poetry, and 
especially lyric poetry, merely utilizes the resources of 
language more fully and in a more concentrated fashion 


than do other types of literature.?* 


Summary. The overall implication of the above 
comments on the general nature of poetic language for the 
teaching and hence testing of poetry is that the central 
task is to give the student a clear understanding of the 
nature of poetic language in terms of its purposes and to 
give him a clear understanding of the differences between 
the ways in which poetic and discursive language operate. 

The chief implication of the preceding discussion 
for*+the present study is that teachers require accurate 
means of measuring the degree to which students achieve 
thet" cheareéunderstanding” (referred wtouinasthetpreviiousnpara= 
gueaphiem [hh thehacceptancesot sthescoteridgeangideatos 
Morganic unity" is as widespread among poets, critics; and 


teachersmasva sunvey of thesrelevanteliteratunesandicates, 
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the testing of poetry ought to reflect this idea; thus 
testing must focus on the student's ability to recognize how 
the individual parts of a poem relate to their context. A 
valid test of poetry must require "distinct and perpetual 
ect entaongd wormthesvariousmpar te: invorderyto@arrive: atvan 
understanding of the ways in which they relate to each other 
and to the whole poem. Unlike the many poetry tests which 
treat these parts in isolation and appear to make no 
distinction between poetic and discursive language, the 
presenterestvattlemprsuto dealewithypcetry on iLtseown terms. 
That is, in focusing on the process by which the parts 
interact with the whole, it proceeds on the assumption of 


Porganig~euni cy. 


speciticpstructuralyElementsyot) Poetry 

Over the centuries poets and critics have supplied 
an abundance of material on the nature of poetry and the way 
its various structural elements such as’ rhythm and metaphor 
econtre@pbuteetowardsthettotal meaning tom akpoecme, Lees 
neither necessary nor possible for a review such as this 
to deal with all these elements or even with any of them 
with any degree of completeness. What is attempted in this 
section is rather to review statements by authorities on 
poetry concerning four of these structural elements (connota- 
tion, imagery, metaphor, and sound) which seem most relevant 
to the central’ problemeot this’study: “that of Wearning how 


to respond adequately to poetic language. 
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Connotation. The words of a language, aside from 
their denotative, or dictionary meanings, carry with them an 
accumulated suggestive, or connotative meaning. Vygotsky, 
speaking of language in general, points out that, "The 
sense of a word is the sum of all the psychological events 
aroused in our consciousness by the word," and Ogden and 
Richards, also concerned with enlarging the concept of 
linguistic meaning, note much the same thing: 

Words or arrangements of words evoke attitudes both 
directly as sounds, and less directly in several MAYS 
through what are called loosely "associations" : 
More important than the sound ee of words are 
the immediate emotional accompaniments due to past 
experience of them in their typical connections. To 
get these, there is no need for the connections them- 
selves to be recalled.3 
Thus words, in varying degrees, take on feelings, whether 
used in poetry or in everyday discourse. The difference 
between the way connotative meanings operate in normal 
speech and in poetry is, as Ciardi points out, 
simply that the poet makes his selections with more 
acute attention to the various forces within the word. 
For the person who is a language-sensitive, every word 
has its own personality .. .; every word releases its 
aura of feeling. 

The tendency of words to gather emotional associa- 
tions from everyday experience is perhaps the chief reason 

A en : : 
Gulf Nadelht (eyes. (eerie doi, Vera 
evygotsky, OD eeCInt jf HOU. 


3ogden and Richards, The Meaning of Meaning; p. 373. 
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Lore the power of "poetry. TS. Eliot, noting the symbiotic 
nature of the relationship between poetry and everyday 
language, points out that 

The poetry of a people takes its life from the people's 

Speeen and in turn Gives lire to tt, and represents its 

highest point of consciousness, its greatest power and 

its most delicate seneimilate 

BubsconnolLation 1S also the: source of much ct our 

difficulty with poetry: because of its centrality in 
poetic language, non-native speakers find it almost 
impossible to appreciate the poetry of a language other than 
their own. As Richards says, it makes poetry untranslatable. 
It also determines the way the poet must operate, and raises 
a problem. To exploit the full evocative power of language, 
the poet must lean heavily on what Conrad calls "the common- 
pLaceesurtacevor) words. cfo the, old, ,oddiwordsyewornt thin, 


2 
He must, however, use 


defaced by ages of careless usage." 
these "old, old words" in creating new meanings. If he 
yields toc much to the temptation of coining new words, or 
of creating a specialized diction, he fails to tap the 
deepest feelings of his readers. So important to the total 


poetic etLect is Connotative Meaning that poets gave great 


Gare to establishing the right relationships between the 


Tn, SE MOU, ecnemUSe OL Poetry, andthe Uses or 
Critiezsm (london: Faber and’ Faber, 1933), 9p. 15. 


2 Joseph Conrad, The Nigger of the Narcissis: 
Preface (News orke Vintage, nL 965)%" po 1k. 


! s 

~ oo 2=2e oy 20 

é (tinbiste 4 
7 _ = 

ait toy Shoe ee 


a 4 )\4 rev? 7 
eo ok naas Te 
ay: , “ — aa 

, 4 ove! es - 
> i 
j a | 


; , ‘" st aisty ar sw ¥ iu +7 1°] 
te . : 4 - : , . =e 
gg } Se seate " eek ed og 


“ie sep gS? ie ae & 
: ' é ot ein o9 spite 
a rei, its - usta. 4 as yes TP 


ri . hae So 2 -«eD =| ony 
-_ 
yt? <stzewateh cols QE 


‘ voles? OF sma tde I : 


~~ a 
= - o-~ . 92. H <1% et pr nv - 4 Ja 
= 7 ’ 
. 7 7 
> Te 
LZ os See aii | on Sal 
rieins ip pe Get Re 
| | 
< - 
7 
. 7 r tet ' 
. ( og am *< : vane, ive ht 


eaines 
=a . 2 m4 wnt @£5° RY (een aot ab 


iv 


mir) re OT 4 see 


p. i manta ry iad 
. > 

_ 7 7 
er; 


43 


connotation of the words in a given poem.* 
Connotation is closely related to the other dimen- 

Sions of poetic meaning. Imagery and metaphor, in the sense 
used in this study, can be considered as merely specialized 
forms of connotation. The dimension of word sound, however, 
is the one most closely connected to connotation. According 
to Ogden and ‘Richards, 

The means by which words may evoke feelings and attitudes 

are many. . . . AS sounds and again as movements of 

articulation, as well as through many subtle networks 

Ob associations), (he contexts. of their occurrences Gn 

the past, they can play very directly upon the organized 

impulses of the affective volitional systems.¢ 
Ullman, a semanticist, also notes the closeness of the 
relationship between the sounds and associations of words,> 
and Ciardi notes that most people respond instinctively to 
the musical gualities of words.“ Ciardivs Views? that 
connotation presents less of a problem in teaching than 


imagery and metaphor, because its use in poetry coincides 


more closely than theirs with its use in normal speech. 


Imagery. Literary critics have often used "imagery" 
to include all uses of figurative and metaphoric language. 
inethso study, wagery. denotes the representation through 


language of sense experience. Though it most often 


Vedardi, Wetele veie, 
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suggests mental pictures, imagery is not confined to the 
Visual ween aay Lepresent samsound, vaucme lity ota touch. 
imagery! ts? particular lyiimportant tito: thelipoet 
because of its power to evoke experience and to arouse 
emotions through producing mental reproductions of sensa- 


tion.? Most authorities on poetry are in substantial 


agreement regarding the importance of imagery.°141>16 


Spender, speaking from personal experience, insists that 


The poet, above ail else, is a<person: who never forgets 
certain sense impressions which he has experienced and 
whichehercan re=-liveagain and ‘againas! though with ala 
their original freshness. 


AndeConrad, though @eferring specitically to fiction, voices 
his belief in the central role of imagery in literature: 


My ‘task which I am trying to achieve is, by the power of 
the written word to make you hear, to make you feel - it 
is, before all, to make you see. That - and no more, 
and? tan seveny ih ine ac 


Clearly imagery is closely related to the other dimensions 


ie eee Perrine, Sound and Sense (New York: 
Harcourts brace, (1956)),,p. 45. 
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of poetic meaning examined in this study and can perhaps be 
considered:as a special kind of connotative language. Many 
critLrestevensgo so: fareasito lumphall poeticicomparisons,; 
such as metaphor, under the heading of imagery, but for the 
Purposes Or this study Yimagery", in line with the above 
statements, will denote concrete language making its primary 
appeal through the senses. 

The ordinary reader's problem in responding 
adequately to imagery is that he has been conditioned to 
respond primarily to abstract, discursive language. Ciardi 
refers to a word's "picture-making power" as an indispens- 
able function in determining the feeling of a word. He 
says, "Words are most richly conceived as individuals, each 
with its own history, each with its own locked-in picture. "+ 
However, as Barfield points out, this "picture-making" 
function of a word is countered by an opposite, often 
Stronger, arOucepanby awhichin. amtrysinglesmeanings |) tendato 
split up into separate and often isolated concepts." 19) 
this continuing war between unity of meaning, one of whose 
chief defenders and examplars is poetry, and fragmentation 
and abstraction of meaning, clearly evident in the language 
of science, the latter appears at the present time to be 
Winning seTne Uninitiatedsreader (of poetry, Caught in, the 


middle, cannot be blamed for “groping about" as Eliot puts 
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Lt LODMwna tei caabsentenmew. BCOmedaki ndeofimMimeaning “swhich 
is not«there, and istnot»=meant to be Gana ue He has been 


taught to look for a meaning which is now evidently missing. 


Metaphor. For the purposes of this study "metaphor" 
is taken to be synonymous with "figurative language" and 
includes the use of simile, personification, and metonymy. 
POmdeGrCa ue extent ai1sOmincludessine mise ot esymbol), pOclt 
metaphor and symbol being subsumed under what Ciardi terms 
"the metaphoric sense". Emphasizing the centrality of 
metaphor in poetic language, he says, 

Nothing is more characteristic of poetry than this meta- 
phoricesense. « / .othiteral-minded readers. “Se. are 
forever in difficulty with the metaphoric sense of 
poetic language. They want to know "what a poem is 
about," and they resent the essential duplicity whereby 
the poem is never entirely what it seems to be about. 
This “essential duplicity" of metaphoric expression is also 
noted by Perrine, who talks of "Saying one thing and meaning 
another" as a means of adding extra dimension to language, ° 
and by Walsh, who says, 
Pocticm nd rect tone! cs) motmaneopeLonank adornments salt Gis 
a method of putting into words, with exact fidelity, 


ideas and emotions and moods that might otherwise elude 
the capacities of language. 
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It is now necessary to look more closely at the way 
in which metaphor achieves its remarkable effectiveness. It 
was noted earlier that there appears to be a natural 
tendency in the development of language for single meanings 
to become fragmented into isolated and separate concepts or 
abstractionse and®that’perhaps™onerofsthe chiefefunctions of 
POCtEY 1S" toO* Opposes this* process , creating’ or®restoring 
unified, rich, complex meanings. In a previous section 
dealing with the multiplicity of meanings in poetic language 
it was noted that deliberate ambiguity or plurisignation is 
one effective means of expressing large and complex meanings. 
Perhaps even more effective in this struggle is the use of 
metaphor. Richards sees the distinguishing mark of the 
poet in his ability to make original and apt connections 
between different elements of his experience,- ay gle! 130A IE e 
Warren states that 

. . other things being equal, the greatness of a poet 
depends on the extent of the area of experience which 
he’ can*master poetically. 2 

One of the most effective devices in the making of 
these connections and in the "mastering" of a wide area of 
experience is metaphor. But metaphor does not merely act 
as a device for gathering and combining a large number of 
fixecdsmeaninos..  Lueaulows: the poet ,-=tiedeact hem seto ithe 
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function of creating fresh meanings through combining words 
and ideas in new ways. As Barfield notes, 
the principal means by which creation of meaning is 
achieved 1S... . métaphor. But it must be remembered 
that any specifically new use of a word or phrase is 
really a metaphor, since Tt attempts to arouse cognition 
of the unknown by suggestion from the known.1l 

Coleridge, who has provided some of the most per- 
ceptive and influential insights into the relationship 
between poetry and the human imagination, sees imagination 
not merely as\a picture-making faculty, but as the agent 
which enables the human mind to conceive simultaneously of 
universal forms and the concrete, particular world. As 
Rate says in discussing Coleridge, “Imagination, expressing 
itself through poetry, 'fuses' the insight of reason with 
the impressions of the senses." Clearly metaphor is one 
of the chief means for effecting this fusion. 

But in arousing cognition of the unknown by sugges- 
tion from the known metaphor, far from simplifying meanings, 
far from handing the reader a ready-made relationship, forces 
thesreadersto participate in, the creation—--or xe-creation—— 
Ct meaning. Like ambiguity, metaphor not only allows for 
multiple meaning but erects a wide and complex frame for 
possibilities of meaning.  CGiardi says of metaphors and 
symbols, "They often manage to feel more than one way at 
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specific in order to emphasize some larger possibilities of 
; wal 
meaning. 

Metaphor is one of the principal means by which, in 
Richards' words, a poem becomes a "set of possibilities," 
wath dynamic, fluid wmeanings). In’ Richards! view) itis the 
activity of the reader in making the kind of connections 
demanded by metaphor that constitutes the real meaning of 
poetry. And Perrine, commenting on the power of metaphor 
to provide delight by involving the reader, says, 

First, figurative language affords us imaginative 
pleasure. Imagination, in one sense, might be des- 
Cribeds as, that Vetaculezein -thesabinaty oftthe mindtthat 
proceeds by sudden leaps from one point to another. . . 
The mind takes delight in these sudden leaps, in seeing 
likenesses between unlike things.2 

But these very advantages in the use of metaphor, as 
in the case of ambiguity, have concomitant dangers for the 
inexperienced reader. Metaphor is perhaps the clearest 
PlISterAaALLON. OL poetry Ss typical, tendency sto “all—but—-say | 
Changs. Plfyskills-un, metaphor [iles: inj notrquice-saying 
things, the reader, forced to make connections which are 
often extremely subtle and complex, can easily misread a 
poem. As in the case of ambiguity, a high degree of 
Sensivivicy toethe context of the whole ypoem Misinecessary in 


the reader's adequate re-creation of metaphoric meaning. 


Otherwise ne is likely eGrther to overlook the metaphoric 


loiardi, @yoy, tenle ds ) Woy  7anler 


*perrine, her, aes pels Seca onsls 


ve aeasones’ «| 
we eet a: | 

gga Mlaiper 22° 158" a eaunet Bet are 
ale st away Weenies ak veo eeie 


@rnrisetca> To bets e.> -citrit Waris 


7 7 
2 panighen Yor sRG, Sid. 0, eHEUIENE orl st ee 
gehen | iAbwers-igakd 2 bsnl mt sHplgen abdie 


med Drauc te debt) GB BF GOR S08 

ee ee See See SO © 
Jets, Baa wR pee > rug y 

, % eGIGRA eh 1104 ong 

‘942432 ae argent be isp Ase: s Hii.) 


. Pe er) } = 
w6 Jomgasem. WO 686 oft fs 


ats xy RIS °F Vara yuo bel 
Sopris of agest 


‘wap dgdshle" OG utes: 


ta 


ensued -esE4h- oor yt ao 
eta ti daly. moka «9 

a Rawye lov vioiee.|! oo.*, ee we bas oboe Choma s2eo WD. 

a : oo 

ie petGad tein «temic ter See aid G2 ahe 

at, ae 

ck yeRiesor. 6k iene HOt mis 1 VR een ald, oF ava 

ELAGoG el acd gn Oe: ponlemts-7 jnipsie. @7% 

pbariquct an ne Nooisbve 61 1dheie dianed Se aut 


Saal “ Ag 
@ f 


Me 


Bay of ba DAT) -Ge4 
ieee Jaq 4 eto! pe: 


a5 ie 


50 


relationship or, as Richards found, to impose his own pre- 
suppositions on the relationship. As Turbayne says, the 
price of the use of metaphor is constant vigilance, the 
danger being of reading elements into the metaphoric 
relationship which violate the total impact of the poem.* 
“The victim of metaphor," says Turbayne, "accepts one way 
of sorting, or bundling, or allocating the facts as the 
only way." Again, the answer appears to lie in Coleridge's 
exhortation to give "distinct and perpetual” attention to 
all the parts of a poem. 

It is not unexpected, then, that students need help 
in learning to respond sensitively and observantly to meta- 
phoric language. They need to be taught not to expect to 
exhaust the full meaning of any given metaphor or symbol 
and to avoid the temptations of symbol-hunting and reading- 


in meanings unwarranted by the context. 


Sound. Pope's famous line in "An Essay on 
Griticism’, “The sound must be an echo to the see, 
remains a remarkably accurate description of the part the 
sound of words and groups of words plays in the total 
meaning Olea poem. it AS important to note that “sound, 1s 


not an equal partner with "sense" in creating poetic 


ye M. Turbayne, The Myth of Metaphor (New Haven: 
FALes UNL Versitys Prescy 1I902) nb. 27. 
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Meaningseat as ,Mratherpheanssecho "Soin other words, sound, 
dissociated from the denotative and connotative meanings of 
poetic language, has little or no value. On the other hand, 
if the poet or reader is not sensitive to the sounds of 
individual words and to the rhythms of phrases and sentences, 
the? total poetic eifect is  signiticantly diminished, and the 
full value of a poetic experience cannot be communicated. 
Scha tier, Conmmencingronenhacnards!) theory OL poetry». points 
out that in Richards' view the source of the musical delight 
of poetry does not lie "Simply in the pleasures provided by 
the sound of the verse," However, as he goes on to say, 
When we view the words of poetry as being invested with 
their meanings, sound patterns become a movement of 
meanings, not simply of sounds. It is this movement in 
which we delight. Using Coleridgean hints Richards 
thus assimilates the musical appeal of verse to the 
growth in meaning characteristic of the coadunative 
imagination. 2 
Ook: eS. ; Cavey on OP enone) 
ASWMOnVWECL LLICSmi neni, = Bariied dian Clarday 
Spender®) POLMEMOUL,) in pocery,, Unlike musa cyesound) us 
always intimately connected with other dimensions of poetic 
meaning. Words cannot escape being sounds produced by 
muscular action; neither can they escape being vehicles for 
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other kinds of meanings. Ullman notes, 


Where a sound happens to occur with a meaning to which 


PUslesialuLarey attuned, 1 ew ll. | +. add waisrown 
G@xpressive force to thegsense by a kindlor Yresonance” 
erfect, = 


and the comments of Ogden’ and Richards, cited earlier, about 
the interdependent relationship between the sounds and 
associative values of words, reflect a similar point of 
view. It can be readily seen that most of the above-quoted 
comments are essentially footnotes to Pope's famous state- 
ment. 
the Specific ways in which Sound contributes to 

poetic meaning can perhaps be most usefully examined by 
using the concepts of mimesis, onomatopoeia, and rhythm. 
Concerning the first two, Ciardi says, 

The act of producing a word involves breath and muscle, 

and various kinds of muscular activity tend to produce 

various kinds of feeling. . . . When the muscular play 

tends to enact the denotations of the word as in 

POREGCEICEOLtCAtLON (601 Oye elle tie woOnd unas 

be called mimetic. When the sound of a word imitates 

the sound sot what Lhe wordsdenotes, (buzz, scLuncm). then 

the word may be called onomatopoetic.2 
Ullman makes this same distinction, referring to "mimesis" 
as “secondary onomatapoeia."> 
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cne other elements or ay poem, Such as | "diction, imagery, 
rhyme, line length, vowel qualities, consonant sequence, 
and grammatical structure. .. .+ 
PHUSt2 ayn, aparece cromeactingsin= conjunction witn ocner 
sound values, acts in conjunction with the other dimensions 
of poetic meaning. It should also be noted that the 
creating of rhythmical meaning is not simply a matter of 
strict adherence to a formal metrical pattern. As Walsh 
points out, 
There is nearly always a tension between the theoretical 
rhythm of poetry and the way the words would be 
naturally spoken aloud if the poem were read like prose. 
MhHescension -"one@might almost call=at a lover's 
quarrel . .. Lexists] between the theoretical and 
actual rhythm. 

Because, as Murphy points out, most readers are 
accustomed to responding to words only referentially, they 
Pindewoeolorloulie tO ilesponcmcOmt nee scOouncS OL WOLrds , and 
need constant practice 'fooling around' with words to free 
themselves from what they take for granted and to begin to 


see--and hear~--words as sources of delight in themselves. 


THE TE STINGSOR EIT ERATURE 


Bruner, stressing the need for tests which will 


encourage and measure intuitive thinking, says, 
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Usually intuitive thinking rests on familiarity with the 
domain of knowledge involved and with its structure, 
WIMCRMMakes At spossible= for the thinker to leap about, 
skipping steps and employing short cuts in a manner that 
reqiires clelaten trechieditingroL conclusions thy tanaly tic 
means.1 


Although Bruner is not referring specifically to literature 
OlMLO Tier testing Of poetry, nis comments on antuitive 
thinking are eminently applicable to the evaluation of 
literary response, especially of response to poetry. His 
conclusion is similarly pertinent: 
ipeisecertainiy clear thet procedures, Or Anstruments 
abewnceded to characterizesand measure intWltive thinking, 
and that the development of such instruments should be 
pursued vigorously. 

Authorities on English teaching are almost unanimous 
in stating that what matters most in the teaching of litera- 
ture, something usually termed "appreciation", is extremely 
aG@ericuberand perhaps impossible totevaluate adequately: 
PMerdibiteultyevs die, asslobanspointstouu, SLOREheminkerent 
couplexviy on e@literature,?: wWwHichelismac: Vast tand fas ideep as 
life itself,"? ang see) TAeORLachethiar fstudeny responce rto 


literature, as Loban, Ryan, Sepia andsmany “others note, 


involves much more than factual recall and comprehension. 


erone GriBrunen, lhe werocess fomskcuca tion 
VGanbriode palaces. it. Harvard University ePress, 1960) 3p. 8 


2pruner, QiaeC Lire metOle eOrL 


3walter Eoban) aw valvUa binge CLOWEARL gene. Sud yor 
Mecevaticey. Englisi Journal, KXXUV (November, 92947)\, 283. 


4walter Loban, Margaret Ryan, and James Squire, 
Teaching Language and Literature (New York: Harcourt, Brace, 
DOC Leap ae sD): 
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What it does involve appears closely related to Bruner's 
PonGuueronl y 

Many authorities also deplore the shortage of 
adequate measuring instruments and either directly or by 
implication offer certain suggestions as to the form the 
necessary instruments should take. 

leat theremistneed fovkquveater precision) etse) jeknoy— 
Podgeyotawhatslshmeasived in each item, so that analysis of 
Performance Onpandividiua hed temsewil be producesmorescetar led 
knowledge about student response. 

2. Research is dependent on the development of 
betvermumores valids@andgreltabie) Objectavertestsss Theresis 
aeneed Lom better objective tests. Although there is sub- 
stantial agreement among English teachers about the virtues 
of the subjective, "open-ended" testing of literature, many 
authorities (Bréenings | sre, Gunderson”) POINEs LOpEne 
relatively greater degree of precision and reliability 
providedtby objective testiltems. «<The kindsoftcomparison 


required for research, they argue, requires this kind of 


Tangela Broening, "The Development of Taste in 
PiLeGeaturewine the viign school, “in Nb ssmith) (eds) ihe 
Development of Taste in Literature (Champaign, I11.: 
NMC Ree OG oe fo. ou 
2m. Cc. Budd, "Research Designs of Potential Value 
iminvestigatiungeseoblems in English, in Research in lene 
Teaching of English (Champaign, I1ll.: N.C.7.H., Spring, 
IST ie Sie 


3poris Gunderson, “Flaws in Research Design, ) in 
Researchsin the Teaching of English (Champazgn, Ill. : 
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rellability and= precision. What tis needed they-isaye is 
more work in the development of new kinds of tests.* 

3. As Bruner and others repeatedly point out, there 
is’ avneed ‘for (testing procedures which measure the student's 
knowledge of the fundamental structure of a discipline and 
whitch measure this ability *to apply its ‘basic’ principles. 

Too many literature tests continue to confine themselves to 
purely factual knowledge. 

4. Closely related to an increased emphasis on 
structure is the use of works or passages previously 
unknown by the student to measure his grasp of basic con- 
cepts and principles rather than what he remembers of what 
he has studied in class. 

5. There is a need for tests which will encourage 
and measure imtuLerve sthinking pamuchtotiwhicieremo ten 
falsely termed "guessing", so as to make “explicit provision 
BOmrmtie Cultivatvon sor (Courage sin taste." 

6, There is a need for the development of proce- 
dtires (for investigating “avstudent's "thought rprocesses vasehe 
reads or solves a problem or responds tora test question. 
MiseLlssobviouslyevery “dilificult bécausemthe activityfis 
internal. It is therefore essential to devise measuring 
techniques which promote this "thinking aloud" and which 


permit it to be examined. 


apudd loc. taie. 


2pruner, Soe hen A a5 Aer 


| 
iwi 

dinaien te sano apc sce i oe . 

bab-dankginniD.o fo: wAnsad':t4 thane Z oak 


_ 


centiponkia. Ola asi he oF asmapal ‘ aie 
en siuline! caltinns irene col ae Lonpaaraks yiusin Os 5 
arr - 
SNSinancies, tiahtpett an ws Phat Side SA eae | Hol? bar ? 
slecciVty BOHR SAC so 22 ne oS Sel esa ek: 191 
apes Shand Io-Warie 46H Bsle eas ct Sua a soto 
+. Gis @ipiivetien al inf pols esate wit 
: ioe «jo kahecanl aaa 
apxaeontio Lidw pie GINO" pao. Se eee + ee ae a 
gqva0. 4) foidw ato ¢oum Jorn. vieeagas awe Ome 1 
goketvateadscbiqhs” aidan 2! 2+ os * iitecwie™ honor qlewkel 
nde)! et) soy ies ae ie ee ie 
—S004 910 GhgaeAere) ons 12" eri 8. aE stot Pr ig “aot 7 
aap weateonad JHBUONS = temous: & uit eperaavine, ae 
mereeeGD 2257.6 st ataege1 i mpgdex® © eovice yo eb : 
ea pee ers. @fmo Jivoe T2725 Stew ‘yimendvae et @ 
quiieiuaen agtvet. +3, ieisisees ass wet? wieghe’ 7 
debit bee. heels qasaksds” = ie sacs ote Lite eas 


a ai ita 
i pre! . 
7 : 1 


oi 


ioe NG WISe OLeVvarlanty Ore spol led "eversions 
appears to be a promising procedure. Many authorities in 
the teaching of literature, ancluding Murphy and Richards, 
point to the possible insights into the nature of student 
response provided by a technique of requiring students to 
choose between original versions of literary works and 
versions which have been deliberately distorted in various 
directions. 

The above considerations serve as useful guidelines 
in shaping the design of the present study and in construc- 


ting the Poetry Test, as reported in Chapter III. 
SLUDiES OF STUDEND RESPONSE TO LETERATURE 


In the last decade there has been increasing 
interest in the enya s@ugaes CAMer student response to eee 
ture, particularly to novels and short stories. Squire's 
study) Hhe®Responses of VAdolescente to hour shore Stories,“ 
which forms part of a series published by the National 
Council of Teachers of English, -classifties responses ‘under 
six headings: ‘Literary Judgment, “Interpretational, 
Narratzonal; Associational, SelfsiInvolvement,) andi‘Pres= 
Grip bivesvudgment.  usquire!stpruimary plinding pothat Gar mayor 


portion of the response (43 per cent) came under the heading 


Murphy , Bie CHM = row ielG, 3 Haas 


2 Tames R. Squire, The Responses of Adolescents 
While Reading Pour Short Storiess (Champaign; Ills. EN.Col Eb ., 
LS GA)% 
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inter pretational, is at first sight encouraging as a reflec- 
tion of the over-all effectiveness of literature teaching. 
However, it is the writer's view that this finding was 
Nalnlytamresult of Saulrevs method of investigation, in 
which students reacted, orally, to a series of fragments. of 
SHOte Storlvec eOguire. furtiec re Ounduthar theyoquallty Of 
individual interpretations was generally unrelated to the 
intelligence and reading ability of the subjects as measured 
by standardized intelligence and reading tests.” He con- 
cluded that his findings concerning responses to short 
stories cannot safely be extrapolated to knowledge of 
student weesponses to other kinds of literary selections, and 
that additional research in response to other genres is 
needed. His main conclusion for the present study is that 
adolescent readers clearly need guidance in learning to 
interpret literature.? 

Wilson, using Squire's scheme for classifying 
responses ("interpretational", etc.) studied responses of 
college freshmen before and after the study of selected 
Wovels. ~He, touna that the study of these novels increased 
thew percentage of interpretive responses, “and that there 
were marked individual differences in response to intensive 
srudvye | With some subjects interpretive adequacy increased 
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as the intensity of involvement decreased, [while with others] 


= Ld ° AL 
interpretive adequacy decreased as involvement decreased." 


He, like Squire, concluded that a high degree of interpreta- 


: 2 
tional adequacy was rare. 


Purves, in a study published in 1968, attempted to 
categorize “The Elements of Writing about a Literary Work" 
an TOroer LO provide a, framework for further empirical study. 
Though the kind of research undertaken by Purves does not 
jend itself “to empirical<conclusions) hHewraises’a basic 
question touched on earlier in this chapter: 


Does [self-conscious analysis |] inhibit enjoyment of 
literature? After all, one may argue that engagement 
ps eche prittany goals imate raryveducatioen. W720 le Witth— 
out engagement - unspoken or spoken - there is little 
point in reading literature. It becomes a mechanical 
exercise. =. . . Tor the ‘extent that this is true, equally 
true is the counter that omnivorous reading without any 
thought is of tarnished value. The unthinking absorp- 
tion of books is peripherally educational in the same 
way as is intricate analysis pursued for its own sake. 
There is, however, a balance, and this balance would 
seem to be the aspiration of education in literature. 
The teacher's function is to strengthen [the students' 
Capacity to respond }.3 


It is precisely this "capacity to respond" with which 
the present study is concerned. Squire, Wilson and Purves, 
have concluded that high school students’ response to 


Piterature requires Caretul cultivation. @his cultivation 
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obviously demands exact knowledge of all aspects of this 

response. In attempting an analysis of student response to 
pocticwehanguage,. this) sbudywisceksito iprovide: monemdetanilied 
information about response to literary language at the word 
(and phrase) level than has been supplied by these previous 


studies. 
POETRY TESTS AND STUDIES OF RESPONSE TO POETRY 


In 1923 Abbott and Trabue developed a test for 
measuring students' ability to judge between original and 
altered versions of whole poems. This piece of research 
is reviewed here in some detail because of its uniqueness 
and because it, more than any other, provided a basis for 
the experimental test devised for the present study. The 
poems comprising the first items were arranged in an 
ascending order of difficulty, and the variants were devised 
so as to weaken the original "by diminishing or annulling 


2 


one of its characteristic merits." Accordingly," among 


these "characteristic merits" systematically distorted or 
weakened were "the emotional tone, the imaginative quality 
Ofsthestthought ,.and: theurhythiiae form."> Thus, each item 


consustedtof fa. choice amongiian original) version; ea 


Paiian Abbott and M. R. Trabue, A Measure of 
Ability to Judge Poetry (New York: Teachers College, 
Coluiovdmuimvems ty, @L925)°. 
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sentimentalized version, a version in which the imagery was 
weakened or distorted, and a version in which the rhythm was 
interfered with. The investigators were concerned about the 
gap between the goal of developing critical appreciation 
advocated by the "theorists" and actual teaching and testing 
practice, and deplored the fact that most tests purporting to 
be measures of "literary appreciation" were actually measures 
of the ability to repeat a body of information. 
Abbott and Trabue believed that 

If it were practicable to devise an objective test of 

independent critical judgment applied to specimens of 

the art previously unknown, light would be thrown on 

the degree of success attained in developing the power 

tovappreciate. 4. + . Conceivably something might: be 

learned of the general psychological response to the 

StamitieoLrethesarteinraquestiony< 

Their main finding was that in the group tested, 

ranging from ten-year-olds to graduate students, the level 
of taste was extremely low, and that the test had doubtful 
validity for anyone below college level. This led them to 
question whether or not poetry should be kept out of the 
high school altogether, as something "too bright or good 
forsnature’sedaily food!* | Another findiangowasothati the 
test appeared to have more value as a teaching device--as 
a basis for discussion--than as a testing instrument. Most 


Saigniticantetforethe purposescofy theypresentastudy 7s however, 


was their conclusion that the test 
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May Well be used withe Nigh school classes tor tne 

information they furnish the teacher regarding the 

Uagsteseor Che pupils sclCr Ulegiosct C= otidy sOuetie 

elements OT epOct Cy) wl Dee Very. Nel pr toeany, 

teacher who cares to undertake it.1l 

The test devised by Abbott and Trabue, however, has 
certain serious shortcomings as an instrument for investi- 
gating with any degree of precision the way students respond 
to the various uses of poetic language. It does not 
necessitate intensive scrutiny of individual words and 
expressions as they interact with the whole context of a 
poem; it does not measure with any degree of precision a 
student's awareness of the various dimensions of poetic 
meaning operating in a word or expression, and the extent 
to which they can be regarded as discrete for teaching and 
testing purposes. In not requiring students to match the 
pare cto che whole it fails to caprztalize ona natural 
pleasure in puzzle solving. 
More recently, chiefly under the influence of the 

Work O1 B100m and Nis associates,“ makers Of poetry tests 
have used multiple-choice items in an effort to measure the 
piLiquer. “levels Of COGN@ULGN SUCH as appilacagion and 
aiaiyors.eellis Kind Of test, sal iougn teecOourd. be Considered 
an improvement over previous tests measuring only factual 
recall Ol KnOWleage OL nomenclature, = tends lO Ponore tlic 
a Najelavee Wiis edibepeNensleyn elern icles, seis abe, 


?penjamin Bloom; etial.> Alieaxonomysorekbeucatizonal 


Objectives: Part I (New York: Longmans, Green, 1956). 
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distinctive operation of poetic language--as Ciardi puts it, 
“The way a poem performs itse1ft."+ Hence sit appears “that 
such tests may fail to measure the essential aspects of 
student response to poetry. 

Probably the most ambitious, scholarly, and influ- 
ential study of student response to poetry was conducted by 
Richards, who reported and discussed his findings in 
Practical Criticism, published in 1929. Richards, concerned 
about wnat he termed a general “levelling down" of literary 
taste in modern society, analyzed the written evaluations 
of thirteen poems by a large number of English literature 
students at Cambridge University. In his analysis he 
categorized the main reasons for failure to respond 
adequately to a poem under such headings as "stock 
responses", "doctrinal adhesions", “technical presupposi- 
tions", and “failure to make out the plain sense of a 
poem". He found that few of his subjects, even though they 
were seniors specializing in English literature, could cope 
adequately with the poems. He found his "protocols", as he 
termed the students' written evaluations of poems, ridden 
with the grossest kinds of misapprehension and marked by a 
general tendency to prefer inferior to superior poems. 


Duringethe, course of his investigation he came to ethe 
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2Richards, Practical Criticism, Chapters 4 to 8. 
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conclusion that 


thepeiosest scrutiny of detadls.is compatible with the 
fuilest, LAlIrest, ana most, discriminating appraisal: Of 
the whole. Indeed, the two inevitably go together. 

the sovereign’ termula invall reading is that we must 
pass from judgment of details to judgment of the whole. 
It is always rash and usually disastrous to reverse the 


process... . The, final’ décisions can only be made 
through a fuller, Closer contact with the poem i1tseleét: 
se CimiSebdecarled i observatilon we seeorin 


Chr Gite ten 

Richards, like Abbott and Trabue, found a general 
inability on the part of his respondents to deal adequately 
with poetic language and a corresponding "low level of 
taste." Although Richards' work offers an intensive, 
comprehensive, well-documented analysis of a highly skilled 
critic, an analysis which has had considerable effect on the 
cCeaching OL literature, ity us Not suLticientiy objective and 
GManigilable to admit of replication or to. serve as a 
practicable model for subsequent systematic investigation of 
response to poetry. As Schiller notes, Richards himself puts 
GCreareccress On wine veluesor methodology, but the grearese: 
BOnreripuUllon. Oo. racklCca eGricicism cmcorcri tical and 
educational theory. In its emphasis on the interaction 
between reader and poem, Richards' work has had a profound 
ertect on tie theory and) practice Of Wicerature teaching. 

What the present study attempts to do, tien, is co 
examine in a relatively detailed manner what Abbott and 


Trabucweramined Generally, and towexaminewineasLtatrly 
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objective manner some of the detailed matters Richards 
dealt with subjectively. In this way, this study can be 
Considered an extensiongo! theseutwoustudies...ltusecks, win 
a limited way, to combine the objectivity of the former 


with the detailed analysis of the latter. 
SUMMARY 


In Chapter I a review was made of statements con- 
cerning the need for research in the nature of student 
response Eo poetry and the corresponding need for the 
development of more adequate instruments for measuring this 
Zesponse. | here was seen to. be a serious shortage of this 
kind of research, essential in bringing necessary knowledge 
to the classroom teacher. 

The present chapter attempted to develop the basis 
for a rationale for assessing student response to poetry 
by reviewing statements by literary critics and educators 
Goncerning both the nature of poetic language and the nature 
of literature testing. Also reviewed were investigations 
of response to literature in general and poetry in particu- 
Ueber 

The main emphasis in this review was on the nature 
Op poetics language as It dirters from language used) for 
discursive purposes. The central concern in the evaluation 
Ofestudent Lesponse to poetry was Seen to ber unesnced yror 
devising instruments which measure something more than 


factual recall or ordinary comprehension as measured by 
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most standardized reading tests and which, in testing 
poetry in its own terms, reflect the Coleridgean view that 
a poem is an organic unit, its content and form inseparable. 

The design of the present study, therefore, and the 
NacuLe Om ticurOctry West whiche forms tie central partaot 
the study, are a direct product of a rationale based 
primarily on the concepts regarding the nature of poetic 
fanguage which were reviewed” in this chapter and =toea= lesser 
degree on an examination of Significant studies of student 
response to poetic language. This design and the rationale 
upon which it is based are presented in the following 


chapter. 
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EXPERIMENTAL DESIGN 
INTRODUCTION 


Thesgmamn purposes oruChapter «Lil, 1s .bowdescribe the 
CONnStrMcLion.soL the Poctry Test onuwhich athe major pant .of 
the study has been based. Also described are the Reading 
Test which was used in conjunction with the Poetry Test, the 
interviewing procedures developed for the study, the sampling 
procedures employed, and the procedures used in the collec- 
tion and treatment of data. The experimental design 
required the construction of the Poetry Test and the admini- 
stration of this test, together with the Reading Test and 
follow-up interviews, to eignt classes of Grade X and XII 
English students in North Vancouver, British Columbia. Test 
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view results compiled. 


CONSTRUCTION OF (HES PORTER Ye iwo. 


GencralyRationale 

An attempt has been made in the previous chapter to 
establish a rationale upon which decisions relating to the 
mecucnmo i thisestucy,particularlvaeasmethey, concern athe 
construction of the Poetry Test, can be made. 
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This rationale embraces three principles which have 
been derived from what has been said about the nature of 
pocticmlanguagesu!l First; wpoetic language, because ofmits 
economy, its precision, and its many dimensions of meaning, 
must be read intensively. Second, because of the organic 
unity of a poem and the interdependence of its structural 
elements, the reader of poetic language must be much more 
highly sensitive to context than the reader of discursive 
language.» ' Third, because: poetry isan art form making its 
appeal through the senses and is characterized by "all-but 
saying things", it requires active involvement by the reader 
if its meanings are to be communicated. 

From these principles were derived the following 
guidelines for a valid poetry test: 

I... Mhesbasicxconcerneangthe) teaching! and thesting of 
poetry is the students’ ability to derive meaning from the 
totality of the poetic language. 

Mebeevalid poctrytestichouldtmnvolveractive 
response to whole poems, or reasonably integral sections of 
poems, and should focus upon the relation of individual 
formal elements to the whole context of a poem. 

3 eA va ldepoermy icest sshould® Cecice i nmcenms JoLerehe 
Formaieiclemencvs Whicheeunct1on in Unison to produce poetic 
meaning; only indi rectLyacsnould: at wbenconcernenr with 
students' factual knowledge of authors and of literary 
terminology (knowledge about poems). 
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with measuring the paraphrasable "thought" content of a poem, 
i.e., with the skill in comprehension measured by most 
standardized reading tests. 

5. <A valid poetry test’ should test poetic elements 
Onsthel meowngtermssm iteshouldsitestyskill.in the, apolwvcation 
Ofepoebicfprineirplesprathernthangtherabslityetotverbalize 
about these principles. 

620 Aevalidepoetry stestimustrinvolvesintensive 
scrutiny of individual words and expressions as they inter- 
act: with the total context of a poem. 

7. A valid poetry test must take into account the 
complex nature of poetic meaning, where several dimensions 
interact, affecting each other in a number of ways, often 
in a single word or expression. 

8. A valid poetry test should attempt to make 
provision for responses at various levels of rationalization. 
In other words, it should encourage the kind of "guessing" 
Bruner considers in his discussion of the importance of 
POStCRANG MI NLULtLOM in Scrudents. se HUrtner, thes testashould 
attempt to measure the level of conscious awareness gener- 
ally involved in the response to poetry by high school 
students, and to determine whether this level varies with 
different types of items. 

The Poetry Test eventually developed for this 
Project attemptedeto incorporate: these critenlarby swequiring 
students to choose among original and variant versions of 


whole poems. A word or group of words was deleted from the 
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poem and students (using clues from the context) were asked 
Tomselecterhe »| bést!) qnswern iuomatour alternatives. Lt was 
hoped that sthis procedure would provide for both flexibility 
and precision in the measurement of various dimensions of 
poetic meaning (tone, metre, imagery, etc.). In allowing 
for use of distractors having varying degrees of difference 
Ervonathesoriginal;Monrminiohit answer, thesprocedune also 
promised to make possible a high degree of control over 


mtemraitticulty. 


Development of Categories 

The next problem was to develop a number of discrete 
categories sufficiently comprehensive to reflect accurately 
the main dimensions of poetic meaning. Standard works on 
POCLrY, Such as, those by Brooks and Warren,* Wellek and 
Warren, Drew,> Ciardi,’ and Walsh,> discuss poetic meaning 
under many different classification schemes. Sample 
headings from these works are "Metrics", "Rhyme", "Imagery", 


"Denotatiton and Connotation., ‘Metaphor™, “Personification™, 


toleanth Brooks and R. P. Warren, Understanding 
Poetry (New York: Holt Rinehart, 1960). 


a Wellek and Austin Warren, The Theory of Litera- 
BUGe Mm NEW YORK: | Habcolumte, brace, L750): 


smlizabeth Drew, Directions in Modern) Poetry (New 


NOorkiny GOLAONEPress L267) 


4 John Ciardi, How Does a Poem Mean (Boston: 
sis foh meray pm mmekahayy, Necker’ yc 


>chad Walsh, Doors into Poetry (Englewood Cliffs: 
Prentice-Hall, 1962). 
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WMetLonyiliiee, s.cymbolism!s MAdwegory!! "Paradox" j."Understate- 
mente, 2. Loony» TiTones:y. "“Musmoad Devices", arrdievpa tilerni. 

It was therefore necessary to develop a somewhat 
independent scheme cutting across existing classifications. 
Using Pope's famous line and Perrine's title? as a base, 


two "sound" and two "sense" categories were initially 


Constructed ew rhythmically. andminon=- thy thiucalee sounds and 
"Oenotataive” “plain, sense), and Jconnotative™ (poetic) 
meaning. 


It was decided to use four rather than a larger 
number of categories, partly because it was recognized 
thats suchselements as’ “imagery “-and “tone” rarely act 
independently of one another, and partly to make the inter- 
pretation of test results more manageable. Also because the 
testing procedure required an average of almost two minutes 
per item (each item involved the reading of a whole poem), 
TiaWwaSmeoundanecessaryaeaduringmthespmlom studies tos limit 
each test form to 16 items. With four categories, this 
meant four items per category, which seemed a minimum 
for purposes of analysis. 

Test items were constructed for each of the four 
Gategoriess and tried out onghigh school students? and 
colleagues.) It was discovered» that constructing items for 
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laurence Perrine, Sound and Sense (New York: 
HoOECOVULCE brace, LOGS). 
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Categories presented no Great problem.” The "suggestion and 
"sound" categories were another matter. In these categories 
responses tarlea to’ coincide with the intentron*of items to 
q=slUlPrcrlente degree to ustiry fPurcher=attempcs tor moarry 

the categorization scheme. Consequently, "suggestion", or 
"poetic meaning", was replaced by Walsh's term "indirection",+* 
which includes such poetic elements as figurative language 
and irony. "Non-rhythmical sound" was replaced by "nuance", 7 
also Walsh's term, which includes the connotations and 
sensuous aspects of words as well as their sound values. 
However, in constructing items for the revised categoriza- 
tion scheme, the difficulties encountered with the "nuance" 
and “indirection" categories were even greater than those 
encountered with the first scheme. 

At this point it was decided that these problems in 
categorization were due primarily to the nature of poetic 
Tanguage “itsel{—-to the way in which the various dimensions 
of poetic meaning operating in a word act interdependently. 
This interdependence appeared to be particularly strong 
between, on the one hand, the evocative or sensuous quality 
Cla word and,-on the other, its sound and ats "metaphoric 
Or symbolic sense. “For example, 1f "Much have l "traveled 
iniecnesreains Cmgola'Wrs changed tor. = . Mandss on gold, 


the "plain sense" and metre remain basically the same, but 
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to some degree the sound, and to a high degree the sugges- 
tive value of the phrase are altered. As Richards suggests, 
itvisezmpossiblerto alter the soundso£ .a*word+or phrase 
without substantially altering its connotative value because 
the sounds of individual words and expressions act only as 
a reinforcement to their suggestive qualities. A similar 
example could be given to illustrate the close relation 
between connotation and metaphor which makes it impossible 
wOgalterpenepconnotaeive value of a word without aitering 
Lec metapnonic erfect... Contracturp Like @ rich jewel in an 
Ethiope's ear" with "Like a rich jewel in a woman's ear": 
fleece pOwer Generated by the lignt—on-dark imagery is 
dissipated. 

Consequently, with some reluctance, it was decided 
to combine connotation, imagery, metaphor, and word sound, 
into a single category, to be designated "poetic meaning", 
Because this was considered by far the most important 
category, 50 per cent of the items were assigned to it, 
Wither omeper Cent assigned. tO) CnOught = and s25 pe Cent to 
Pout 1.) SHOWeVer, during the final Cconseruceionwand 
selection of test items and =the statistical analysis of 
Pose ecesilts tic  OCLGunal | SOUnG sCateGory Was recLcoLred,. 
This category, which consisted of items in which the sound 


of individual words and expressions contributes significantly 


oy), Preschrller.) le hvoRichards..  meCoLlyeOnmulterd— 
ture (New Havens “YalesUniversitytPréss;,G1909) 7 pes27. 
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to the total poetic meaning, was, after much deliberation, 
ywucged to be suLbbicientiysdustince  romethe: Ysiggestion « 
Category to be treated as a separate unit. It was reasoned 
tchateche restoring “Of Sthee sound “icategory would ’permitia 
useful examination of the relationship between responses on 
the "sound" subtest and responses on the other three sub- 
CeSsesue Liws-,.*clie tomig ina Peloumsca teqouiecpelve ye lucuchiz, 
Suggestion, Sound, and Rhythm, were substantially the ones 


which were finally used. 


miepoelectton) Of Poems (to .be Used as Test) ftems 

The criteria for the selection of poems were: 

1. Brevity. Only whole poems no longer than 18 
lines and a few reasonably integral sections of longer 
poems were used. 

2-9) Student Interest. Inlorder to gain a maximum 
amount of student interest and candor in responding to the 
test, the pilot study results were used in an effort to 
select poems judged likely to be at a high interest level 
foremost eNO school, students. 

3. Literary Quality. An attempt was made to include 
only poems of reasonably high literary quality. This was 
Bartialivwensuredsby the fact that almostsall ot thepoems 
were taken from recognized anthologies, many of them 
ectually im use aim high school) andjuniversity Courses. 

A Untranvitarity. — Ltawascescentialsthat, thesroetry 


Test items not merely measure factual recall of words and 
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phrases from familiar poems. Thus, an attempt was made to 
exclude poems actually listed in senior high school 
curriculum guides for English courses for Alberta, where 
the pilot test was to be administered, and British Columbia, 
where the final test was to be administered. 

5. Freedom from Unusual Allusion and Vocabulary. 
In order that the test items would not be measuring factual 
Becail, ewiether ofPhistoricadyoremythical-<materialy, oreot 
the meanings of unfamiliar words, an attempt was made to 
exclude poems containing unduly difficult allusions and 
vocabulary items. In a few instances, word meanings were 
appended to items. 
Construction of Test Items on 

the Basis of the Categories 

As has been.indicated, the development of test 
categories and of individual items was a reciprocal process, 
the categorization scheme providing guidelines for item 
construction and the item construction providing a check on 
the adequacy of the categorization scheme. From the more 
than 120 poems selected according to the criteria listed in 
the previous section, items were constructed for each of the 
four categories. Item construction in general proved rela- 
Pivelivecaiiricult, buy atems for Categories, One and Pour 
(Thought, and Rhythm) proved easier to construct than items 
for the other two categories (Suggestion and Sound). 

Distractors for items in Category One were constructed 


so as to alter the "thought", or "plain sense meaning" of 
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the poem, while keeping constant the metre, and, as far as 
possiole;, the connotation andssound + Dastractone forcertems 
lm Cacvegory Four were constructed sso as elther to alter "the 
hature Of “the metrical feet ina’ line or to vary the number 
On Leetewlthin a lines = [her construction of "dustractorse fOr 
Categories Two and Three involved such changes as distorting 
or weakening imagery and changing the connotative and sound 
values of words. This problem proved exacting, and was, in 
the writers qyucagment, nol solved in anventirely satisfactory 
manner in the course of the study: 

With the help of Roget's Thesaurus, and after much 
Tevicron Of -inai vidual distractors 120 @icems, distributed 


among the four categories, were finally assembled. 


Reem oe Lectagon 

From these 120 original items, six tests of 15 items 
each were administered over a period of three months, four 
tc eight Grade XI classes in the City of Edmonton and the 
Countys of Strathcona, -Alberta, and two to foun Grade xl 
classes in North Vancouver, British Columbia. Item analysis 
Waste performed in order to determine measures Of ditfiscuity 
BHoeCiScoiuinatings ability) forveach item. (“ihnese measures, 
together with a scrutiny of the response patterns forneeach 
Gicstractor, mace 16) possiple to ascertain which Gems 
Seemed sufticiently suitable to be retained intact, which 
items were to be rejected, and which items seemed to be 


reparables For the purpose of (these) pre-pilou, studies, 
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DLemeaw. Ua tcwucn fli Cu lives ides pbe.lOowe) 230) andirabove e070 and 
Bien Suwin aa bi serial corce Lat ronson llessethana0iec5s were 
generally considered .unsuitable.. Simidarly, items, in whach 
any one of the alternatives gained either more than 90 per 
cent or less than 5 per cent of the total response were 
judged to. bein; need of sepaix. 

Standard works on test construction tend to hold 
Plate Lem ie ELCmlubies: (proportionpof.cornecturesponses) 
should, except for special screening requirements, cluster 
around the 0.50 level. Because the results of item analysis 
on the "pre-pilot" tests showed a mean difficulty index of 
between 0.35 and 0.40 a general discarding of the more 
difficult items was necessary. 

With regard to the level of discriminating power of 
aw mceem, a Ligure of 0.70 Om Higher 1s considered 
Satisfactory by most authorities for a test purporting to 
measure a homogeneous skill. Because the Poetry Test, as 
reflected in its categorization scheme, was concerned with 
measuring skills at least partially discrete, a consider- 
aplvestower prserial correlation coetriclent was deemed 7a 
satisfactorily high index of an item's discriminating power. 

With respect to the distribution Of student responses 
among the four alternatives offered in each item, an initial 
attempt was made to obtain a "50-17-17-17" pattern, the 50 
representing the percentage of "correct" responses, and the 
incorrect responses distributed equally among the three 


GLStractors. It was later determined that more information 
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could be gained from such patterns as "50-5-30-15" and 
Ose Sahay whierey, fsayeennmoaneetcem Involving metreiise. 
distinction could be made between students with some grasp 
of the operation of metre and students with virtually no 
grasp at all. Providing for differing response loadings 
on the various distractors, then, appeared to make it 
possible to separate grosser from less gross distinctions 
among the alternatives, and hence among students' degrees 
ofiskilil. 

Fifty-four items, distributed reasonably equally 
throughout the four categories, survived these various tests 


for item ‘selection. 


Validation by Judges 

The remaining 54 items were then examined by four 
judges selected for their special competence in the area of 
English literature and literature teaching. 

These authorities, all experienced readers and 
teachers of English poetry, were given a description of the 
test categories and asked to examine each item and to 
oe conmitar Omone eo sathesioumicategemiec. S Them judges were 
also asked to comment on any weaknesses noted in any of the 
itcemsiand tovwidentatfyrany atemsiwhichmwereyconsideredsvery 
Dati iuciniktt meoeca Vegona zen. 

inecoOMnparingeune, Cavegorizativon bysiche 4 udgesmorm all 
54 items with the intended category for each item it was 


found that for Judge Number One agreement was 96 per cent, 
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for Judge Number Two agreement was 81 per cent, and for 
Judge Number Three, agreement was 91 per cent. Because of 
ele neeaetiee of time, Judge Number Four was able to examine 
and categorize only 17 of the items; his rate of agreement 
was 97 per cent. Five items were discarded because of flaws 
detected by the judges, leaving 49 items, and a further nine 
items were discarded as a result of a re-examination of the 
items by the investigator for the purpose of creating two 
Parallel test forms. This left 40 items, for which the mean 
rate of agreement between the judges and the experimenter 
and intended item categories was 94.8 per cent, and the mean 
inter-rater, or "inter-judge", rate of agreement in categori- 


vatlonewas 95.7 per cent. 


@oms uovic bionyor Parallels Monms 

After the items questioned by one or more of the 
judges were discarded, 49 items remained. As was indicated 
in the previous section, two groups of 20 items each were 
then formed to serve as parallel test forms. An attempt was 
made to match the two forms in mean item difficulty level 
and in mean item discrimination level. 

Equal numbers of items from each category were used 
im cach of the: forms and. dan “attempt was) made) within tcate- 
gories to-match items as closely as possible for difficulty 
andwdivscriminating power. «Although every reffiort wasmmade 
through item selection and revision to create two test forms 


as nearly equivalent as possible, significant variation in 
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item analysis results from certain identical items adminis- 
Leredgro Ceiierentygroups sine thes! pre.pi lotY studies 


indicated that statistical parallelism was not possible. 


Thea Oba Gcuay 

The two comparable forms labeled Form A and Form B 
were then administered to two Grade XI classes in the City 
of Edmonton, Alberta. Subsequently follow-up interviews 
were conducted with a random sub-sample of four students. 
The test results were then subjected to item analysis. 

The results of the Pilot Study revealed no need to 
revise either the Directions to Students which prefaced the 
test (see Appendix A) or the mechanics of test administra- 
tion. It was found that while most respondents required an 
average of approximately a minute and a half per item, a 
substantial minority required up to two minutes per item. 
Since the test was designed to serve as a power rather than 
a speed test, it was decided to allow two minutes per item 
in the finalsadministration < 

As a result of observed student reaction to the 
length of the test during the actual writing and opinions 
expressededuning the interviews; ther final. test forms were 
Gonustructedusoeas tosconsistiofrl6e ratherathanse20e1tems: 
Because of the demanding naturenofethe test many, students 
appeared to lose interest and to be inclined to resort to 
guessing after completing eecommates 15 items. Reducing 
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OL making" possible®a’ further balancing of Ehé two forme by 
allowing for the discarding of items which failed to match 


items in the opposite test form. 


Final Revision of Test Forms 

The item analysis performed on the results of the 
Pilot Test administration resulted in the above-mentioned 
discarding of eight items, two from each category, which 
failed to meet the three criteria listed earlier relating 
to the difficulty, discriminating power, and response 
pattern of each item. Also discarded were any items with 
distractors receiving less than five per cent of the total 
response. Also as a consequence of item analysis, certain 
items from Form A were exchanged for items in the same 
categories from Form B so as to produce greater equivalence 
in the Forms. The operations of discarding and rearranging 
resulted in both forms having a mean item difficulty index 
ef 0.45 and a mean biserial correlation coefficient of 0.49. 

Although the two test forms which emerged from the 
final Pilot Study appeared to be equivalent in mean item 
difficulty and mean item discriminating power, a comparison 
by categories revealed small differences for Categories One 
ana Four (Thought and Rhythm): For example, the mean tem 
aEeiculty andex stor hormeA, © THOUGhEE ,, Was sO olyewhile 
EOC eCOrIED | YrnOUCht Wamat Wacw0.46 es MOET Orn Ay Rn ychimi, 
tie mmeaneitem ditticulty index was 0-4 )ewhitewronsrormeb, 


"Rhythm", the mean item difficulty index was 0.49. Because 
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of the variation previously noted in performance on identi- 
cal items by different groups, these differences were not 
Judged’ Subticientby. sserioussto swarrant —funther revision. of 


the test forms. 
INTERVIEWING PROCEDURE 


The following interviewing pattern was developed as 
apr eosulesor triad lesescsionseheldjduring the many Yore-pilot.® 
studies and during the Pilot Study: 

iA Bit ladle perlOdeo fects CaS tet Veumi nutes awas 
provided for establishing rapport between the interviewer 
and the respondents and for explaining the purposes of the 
study. During this period such questions were asked as 
"Did you have enough time?" and "How did you attack the 
questions?" and respondents were invited to give, at any 
time during the interview, advice for improving any part of 
the investigating procedure, including the interview itself. 
It was made clear that adverse criticism was welcome, and 
that the whole value of the study depended on honesty in 
student responses. 

2. The tape recorder was not switched on until a 
certain degree of rapport was attained. Students were told 
Ehatetiey could ask) 105 42tto be-shuteori ateany =timeswhile 
they Wondered any of the questions. This was necessary 
because the interviews were conducted between two and seven 


days after the administration of the Poetry Test. 
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oe ll the "body 2orerhe interview, the centra. 
question was "Why did you select that particular alterna- 
tive?" To make possible some kind of comparative analysis 
of interview results, the body of the interview, taking 
about 40 minutes, consisted of a set questioning schedule 
(see Appendix C) where essentially the same questions were 
asked of each respondent, in the same order, for each item. 
In addition, to obtain information not obtained through the 
planned questions, and to provide some degree of flexibility, 
allowance was made for free response at any time. Students 
Weresrepealedly urged to comment!) Ereely at any time during 
the interview on any of the questions previously raised or 
on anything at all which appeared relevant. 

4. A final short period following the body of the 
interview was provided in which students were again urged 
to comment freely on any relevant matters. Thus it was 
hoped to gain a balance between the relatively fixed core of 
the interviews and an area of free response surrounding this 


Core. 


BOLlOWInNgd thes tinal, edminicthavion Of the POcEry 
Test, a representative sub-sample of ten students, 
Belectedsbysaqrade level, by sex, and by Level or achievement 
aneethiemtest) was Obtained tor thesinterviews. 

Because tOL Mcne GxplonatonyncacuLe oO. theses lucy setuc 


importance of the interview results as a supplement to the 
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data provided by the Poetry Test was considered sufficient 
COeWatrane the Teporting of ithe results of thesinterview in 
a separate chapter. The findings arising from the inter- 


views will be presented in Chapter V. 


THE READING TEST 


The ability under investigation in the present study, 
skill in responding to poetic language, was regarded partly 
aoamspecial tind Of reaqing ski li. —lncorporated, 2n the 
Stucy, thererore,; was the edministration of a standardized 
reading test as one means of construct validation for the 
Poceryalese.. 18S Mazin pointwace csue was, Now closely 
would Reading Test Scores correlate with Poetry Test Scores? 
Also, if it could be found that a reading test had been 
established by subsequent research as correlating highly 
with inteiligence and academic achievement, it would be 
possible to examine further the construct under investiga- 
tion, namely response to poetic language. 

After consulting authorities in reading at the 
University of Alberta and the Mental Measurements Yearbook 
(6th) edited by awa)” it was decided to use the Nelson- 
Denny Reading Test, Form Be Dips Ss eaetest Ol ewell 
Saran lished reliability which could: be adminastered an 


under 40 minutes and which measures skill in Vocabulary, 


on K. Buros, The Sixth Mental Measurements Yearbook 
(ivellands Park, N..J.2 “sscryphon; 1965)%. 


2M. Ua Newoon ands HieC. BDennys line Nelson-Denny 
Reading Test: Examiner's Manual (Boston: Houghton-Mifflin, 
1 6.0.).. > 
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Comprenensionyeand Reading Rates? Further) as) the authors 
poIntecurs 
Research “Pree Indicatedvarcliosesrelationsabetween test 
scores-and scholastic achievement. .. . In a summary of 
57 reported correlations between scholastic achievement 
and achievement in test scores in specific subject 
Mmabrergi vel dspmthetrangesotecoetficients was frome. 10 
to .70, with a median of .48. The Nelson-Denny Test 
showedha correlation Of 67. 
Thus the Nelson-Denny test was judged to be at least as 
useful fortthespurposesPorethis study gas tany sothereor the 
many commercially available reading tests. 
It was decided, therefore, to administer the Nelson- 
Denny sReadingeTestuin saddition totthe Poetry Test. “Because 
each test requires slightly more than a half hour, and 
because it was considered desirable to minimize test 


fatigue, the tests were administered to each class in two 


consecutive periods. 
SAMPLING PROCEDURE 


The sample of pupils involved in this study was 
drawn from a population of about 2400 pupils consisting of 
all Grade X and Grade XII pupils taking the academic English 
programmenin (North Vancouver, British colimbiravecOnythetsix 
Senor eseconGary oChool| SeinesNonen Vancouver; eonlyrLive were 
eligible because one had participated in one of the 
pre-pilot studies. From these five, two schools were 
selected at random, and from each of these two schools two 
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Grade X and two Grade XII classes were randomly selected. 
thesresult was a sample of 19 pupils inleight classes, four 
elassesarrom Grade X and tour classes from Crade XI.  Sadnce 
the Poetry Test and the Reading Test were administered on 
different days, some students writing one of the tests failed 
to write the other. The Reading Test results from pupils 
who failed to write the Poetry Test were discarded, and the 
Poetry wese results from pupils) who fazled to write the 
Reading Test were not used where findings required a 
comparison between the two tests. Thus the sample size for 
statistical procedures involving only the Poetry Test is 
larger than that for procedures involving both tests. The 
total sample sizes, respectively, were 191 and 165. For 
students writing Form A, the respective figures are 93 and 
S5< for Horm B, 9s and 80. 

The sub-sample used for the interviews was selected 
so as to represent students achieving low, medium, and high 
scores on the Poetry Test. Comprising a total of ten 
students, it included two Grade XII students who achieved 
the two highest scores in the total sample; one Grade XII 
student and three Grade X students selected randomly from 
scorers above the 80th percentile in each grade group; one 
GradeuxXil student, selectea randomly from scores near the 
SO ch percentile; and one Grade XID and two Grade xX Students 
selected randomly from scores between the 20th and 40th 


percentile in each grade group. 
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DATA COLLECTION 


The data collected for each subject consisted of 
Grade Level, Sex, Poetry Test Totals and Subtotals, and 
Reading Test Totals and Subtotals. The Poetry Test and 
Reading Test, each requiring approximately half an hour, 
were administered on two separate occasions, each student 
answering only one form of the Poetry Test because of time 
limitations. 

invaddition, the ten students. were <interviiewed from 
two,.to seven days after the writing of the Poetry Test, and 


the results recorded on tapes. 


STATISTICAL TREATMENT OF THE DATA 


Item Analysis. Item analysis for the test as a 
whole was conducted for all items in each of the two Test 
Forms in order to determine the difficulty level index, an 
index of item discriminating power, and the response pattern 
operating within the alternatives for each item. The index 
of item discriminating power was the biserial correlation 
POcEliICi enim ero ince sthius coefficient, 15 yditiacultlsto, anter— 
Breer ein rayhetrerogencous#test Suchi as the Poetry Test, a 
separate item analysis was also conducted within each of 
thestourusubtests = This» procedureshad themettect of sub- 
Stantiallyeraising the numerical value ot the: biserial 
Correlation coefficients, but it so reduced the number of 


items involved that it was considered statistically unsound. 
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However, because it did serve to aid somewhat in inter- 
precrig ene bYserrvalecorrelatton CoOcrElcients, thesresults 
of*the atem analysis within subtests are included in 


Appendix F. 


Intercorrelations, means, and standard deviations. 
Means, standard deviations, and intercorrelations were 
obtained for the eight scores comprising the Poetry Test 
totals and subtests and Reading Test totals and subtests. 
The purpose of obtaining these intercorrelations was to 
examine possible relationships between performance on the 
Reading Test, the two forms of the Poetry Test, and the 


various subtests of both the Reading and Poetry Tests. 


Analysis of variance. Several two-way analyses of 
variance were conducted in order to compare relationships 
between Test Form, Sex, Grade Level, Reading Test Scores 
Ana pert oOrmance on the Poetry Test totals and) onvecach or the 
subtests. Students were divided into top, middle, and low 


groups according to reading test scores for this purpose. 


Factor analysis. A principal components analysis 
Was perrormea On the results from each, ot the Poetry Test 
Forms in an attempt to determine the nature of the underlying 


factor structure in response to poetic language. 
SUMMARY 


Mhis chapter presents a general description of the 


design of the study and the various procedures used in the 
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investigation. The main emphasis is on the procedures 
followed in the construction of the Poetry Test. Also 
described are the development of a suitable interview 
procedure, selection of the Reading Test, sampling proce- 
dures, data collection, and treatment of the data. 

The findings emerging from analyses of the data 
resulting from the Poetry Tests and Reading Tests are 
reported in chapter IV. The findings emerging from the 


recorded interviews are reported in Chapter V. 
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CHAPTER. LV 
RESULTS AND DISCUSSION 
INTRODUCTION 


Be forespresentingeand daiscussingetihe cesultsc! of the 
statistical procedures used in the analysis, some brief 
comments on the general reporting design seem in order.’ 
Mirst, vhe taindings (of therstud ares presentedr under tour 
main headings: Poetry Test Characteristics, Performance on 
the Poetry) Test by Various. Groups, Factors in Response to 
Poetic Language, and Interview Results. Because the last of 
these is non-statistical in nature and supplementary to each 
Of the other three, the results of the interviews will be 
presented in a séparate chapter. 

Second Lt st Obvi oust thatl ingyet tings and “analyzing 
responses to test items, an investigator obtains information 
about both respondents and the items themselves. Thus a 
clear line cannot be drawn between statistical procedures 
which lead to information about tests and test items and 
mhose which 2eadtto. anformation aboutiithe perirormances Of 
mnGivicuals on avparticular. test) om a.tem.9) Nevertnetess(a in 
any given procedure Gheres tends LO mbes a SLOCuS sm hore example, 
Pmeirenecnel Volo tie .coCus 1s Clearly son he stest Or vest 
atem itself, while om analysis ob Variance: witths the test 
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scores as the criterion measure, the focus is on differences 
in performance among various groups of ‘individuals.. The 
FeVOLCinge on Chew Statisticalerinaimgsvor wtliis ‘studyens 
therefore organized in accordance with the main focus of 
each procedure. 

Third, it was decided to incorporate the interpre- 
tacrvor ana Giscussion fof “each or the Kinds of ‘data wrth -the 
presentation of the data rather than to present the discus- 
Sion subsequently as a whole. While this arrangement 
interferes to some degree with the continuity of the discus- 
Sion, it presents fewer problems to the reader in relating 


the crecussrvon co the data- 
IDOMMIPIRN SMESIe (CEUARVNCHM IRI Sales 


Reliability 

A central consideration in the construction and use 
Omeanvetest 1s rellabuirey, rom the accuracy wrorewhicn sa 
score represents the status of an individual in whatever 
aspect the test measures him."* Because a test lacking this 
accuracy cannot be valid, 1t is essential to obtain informa— 
BLoOumaboutenrs: reliabirrey. 

Thesrelraplmiriy Orwa Sel Or Measures slow cmeoreliCca lly. 
febined a5 "tic propor clon Or "truce Var ance; was "Oppesca eno 


errorevarirance, in’ the total variances= Operationally, 


Sai Py Guiritord; Psychological Measurement «New SYork: 
McGraw-Hill, 1954), p. 349. 
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reliability has several related but separate meanings, each 
associated with the type of procedure used in its estimation. 
Authorities in the field of measurement note that the type 
OLPestinatangnprocedurcemosty appropriatersormaegivenssetror 
measures depends on the purposes for which these measures 

are eOnpesusedsandsongpracticaleconsiderationsye suchseas 
evailebijlacypotadatatiany theyproperstormy,. testing) conditions, 
and the kind of test used.* 

Three main types of procedures for estimating 
reliabilaty havesto do with (1) «internal consistency, (2) 
elternarerzorms Woreparal bel sformsiiprediabilityy,eand? (2) 
retest (test--retest) reliability. With the present test, 

a measure of internal consistency as well as of stability 
was considered desirable because the test is composed of 
four discrete sub-tests, each designed to be homogeneous 
with itself. For this reason the test--retest procedure, 
which provides no information about internal consistency, 
was rejected. The alternate-form method, which can provide 
information about both stability and internal consistency, 
was considéred as the most appropriate procedure, but since 
design limitations precluded the administration of both 
Tectwtorms ©O the same Ssubyeckts Lhe intercorrelation 
between the two forms could not be obtained (see Chapter III, 


mat OC) 2. Thus the alternate-forms procedure was rejected in 


ee, Ph Cusadtord>«tundamental@steatisticoc anes ycnology 
and Education (New York: McGraw-Hill, 1965), p. 446. 
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favour of a purely "internal consistency" estimate, involving 
the jwise wf the K-R 20. formulia./- The chief weakness of ‘this 
procedure in the present case is that it provides no 
information about test stability. .This deficiency is partly 
remedied by the interview data reported in Chapter V, which 
yield some information about the stability of the test. 
Because the present test may be considered a highly 
PEreactive’ (measures there: ice aldanger Of Obtaining ta 
Spur ous. ya ulghenreliabilitys cociiicrent) through use) of 
test-retest and equivalent forms methods. The use of the 
K-R 20 formula, which is purely a measure of internal con- 
Sistency, was thought to minimize this danger. 

Tablen dy presents? K-Ry20/reliability*coetricients for 
Enestwo mest Orms, for thestetaly samples andy ther twor grade 
level groups separately. In drawing inferences from these 


coefficients certain points should be noted: 


TAS LE: 


K-“R Reliability Coefficients for Forms A and B 


Source of 


Scores Grade X Grade XII Total) Sample 
Form A Pa ues: 736 
Form B SAS) 64 ais) 


SS a 


emlim cucenerval lyerecognizcdstbatStheshoka20 


estimate of reliability tends to underestimate the 
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reliability of a Hest One of the chief reasons for this 
is that the use of the K-R 20 formula depends on conditions 
rarely met in achievement tests, and only partially met in 
thes present-test. As Guilford notes,™ Ihe derivation of the 
K-ReLOIMMiba £ests On assumpelons Of a Untiactor test. vie 
He alSo noces that with short’ tests (9%to Lseitems)* such as 
the presenc One, Chere as a pronounced negative oilas. 

2. The present test was designed to be a multi- 
factor rather than a uni-factor test and was generally 
successful in this regard, as indicated by the low correla- 
tion between sub-test totals and by the presence of several 
factors (reported later in this chapter); therefore the low 
overall reliability coefficients are not unexpected. In 
view of the complexity of the skill under investigation 
(see Chapter II) these figures, particularly those for 
Grade XII in Form B, appear to reflect a reasonable degree 
of internal consistency. 

BS. lowill betseen- from Table =) that @the relsabidity 
coefficients are considerably higher for the Grade XII group 
than for the Grade X group. One explanation for this 
difference is that the K-R 20 formula assumes approximately 
equal item difficulties. An examination of Tables XIV 
(qe esa, SRA Tape XV {(p. 114) reveals substantially greater 
consistency iiigy aAmeevih @mGaeseel Men eMolslmersiey ameke) Gel@ich Cpactancy y.cilll 


tGuilford, Fundamental Scene CLC Seas O vm Orls. 


*cuilford, Psychological Measurement, p. 383. 
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subjects than for the Grade X subjects. Another explana- 
tion is that because the test tends to be too difficult for 
the Grade X students, the Grade X scores are generally 
closer to the chance level than the Grade XII scores, 
reducing the item-total score intercorrelations: (see Tables 
XIV and XV). The data presented in Table I suggest that 
neveber estat oOrm Us Ssuiiecienulyereltabiles for Gredce 
SLUdenUSalLO Servesas,aabacsas for valid, anterpretation. 

4. The data presented in Table I also show higher 
RoR ZO, COeCGlicients, for Forms Bathan, forsatorm Aj) especially 
with the Grade XII group. This difference between test 
forms is reflected in the mean item data figures presented 
in Table II, where again the relatively greater degree of 
internal consistency for Form B is more marked for the 


Grade, Xiisqroupoethan, for thesGrade x. gqrnoup.. 


TABInE aL 


Comparison of Mean Item Data Figures for Forms A and B 


Grade X Grade XII 
Povmel eer ores Porm Ay Forms 
Mean Difficulty Indices woe 5M) 44 Sonal 
Mean Biserial 
Correlations 39 Aer) 40 aS 
Mean Item Rel. Indices Pople Ls 3 age) a ailie) 
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Perhaps. the most that can be said by way of 


explaining the difference between the K-R 20 coefficients 
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FOr stNestwo "cest Lormseus that wiiwspite. Of bLortevat 
matching, Form B items on the whole seem to either possess 
greater discriminatory power or to measure more idiosyncratic 
abirrires than Porn a. items. 
As a final comment regarding the reliability of the 
test as'a whole, two points can be’ noted: 
io ln an exploratory anvestigatrom suchas the 
present “one; “the “main purpose is"to extract a maximum “amount 
CrmrrireOrnat! Or avout bot the osstb uli ties "Or Mthe etect and 
the responses of the students rather than to achieve a high 
Bobi LeyvecOctl Client, eNaturally, withthe: reliabilityeor 
a test sufficiently low, little information is generated. 
Ins view of “the tcomplextty “of the wski la funder “investigation 
and the novelty of the investigating technique, the 
reliability coefficients presented in Table I appear 
reasonably satisfactory, at least for the Grade XII scores. 
ZeerGUulLLEOnd = points Out that wile io rs impereant 
for achievement tests and tests used in clinical diagnosis 
and personnel classification to be highly reliable, for 
research purposes, much lower reliability can be tolerated. 
Guilford further states, 
Paaewemareateemptind to predict, Culterdamtia traremyery 
eonplexsfactorially, the=best way tovimproye the test 
validityeis to bring ein additional common factors tia 


greta sasinethercriterivon, shouseincreasing Rvediduty eby 
lowering internal consistency medial ey 
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Deuebte ts Well known Ehatereliabtiity can ibe increased 
by increasing the number of items in a test. Because the 
present test is necessarily short (16 items), and because 
Lteprovedsimpracticalsto.administerebothsftorms “to tthe» same 
students, it seems reasonable to estimate the probable 
effect of doubling the test length on reliability by means 
of the Spearman-Brown formula.* As VTeble,  IiT indicates, 
such a doubling of test length produces quite respectable 
wobrabpwrroey coer rrctentsc, PparticilLarly .cOL Forms and tor 


the Grade XII scores. 


dGveeHinleh  ULARRL 


K-R 20 Coefficients Estimated for a Test of 32 Items 
Using the Spearman-Brown Prophecy Formula 


UWenerside Grade X Grade XII 
Form A ales) RS eye) 
Form B A aed -78 


Comparison of the Test Forms as a Whole 


Means and standara ceviations.” It will be yseen from 
Tape iV that both means and standard deviations are” con- 
Biderably fiigher £or Form B than for Form A. However), the 
obtained t-values which are presented in Table V show that, 
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CAE ey 


Comparison of Means and Standard Deviations for 
Poetry Test Totalewior Forms A and 5 


TPOcwetN Grou Grade X Grade XII 


ROrneA Ghermrs FormyA, {FormeaB FormpAs «Form 5 
Mean Gea AAO yy) Swath} Ohegalgy She AW? 
SD 2525 QE arch) 2.95 Zo 26587 
TABLE V 


SigniticancesOL (Ds renence=on 
Form A Means and Form B Means 


Source of t-values 


Scores Obtained tie Cee Dp = 0,00 
Total Sample Ws Shel dee 2258 
Grade X 0.80 PAO 2.80 
Sisacew Aly 3 2202 2.10 
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while there is a Significant difference between the total 
group means of Forms A and B at the 0.05 level of? signifi- 
cance, no Significant difference exists between the means 
POULreceNe CVORgrace Groups. 

Thus the differences between means and standard 
deviations for the two test forms appear sufficiently small 
LO Warrant considering the two forms comparable. The forms, 
however, cannot be considered parallel since for this con- 
dition to be met the means and standard deviations must be 
equal. 

An examination of Table IV suggests that both Forms 
are perhaps too difficult for Grade X students. The Grade X 
means are sufficiently close to the chance level--a score of 
approximately 4 out of 16 on the present test--to cast some 
doubts on the validity of both Poetry Test Forms for the 


Grade X level. 


Meaneitem ditiiculty indices and) biserialecorrelas 
perenecoOctiiclents, The mean item cditiiculty for both grade 
Jevels and for the total sample as presented in Table VI is 
eebstcontiablvyenigner, Lor Form B chan for FormyA.. Jihis eis 
consistent with the differences in test means presented in 
Table IV and suggests not only that both Forms are more 
erutable £or Grade Xi. students but’ also that even tor 


Grade xir students, only Form B approximated the intended 


mean item difficulty level of 0.50. 
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TABLE VI 


Comparison of Mean Difficulty Indices and 
Biserieal "Correlations tor Horms A and 5 


Dawe Cute y, Biserial Correl. 

Forum As ?l0rm B PormaA, Form sp 
Grade X woe aS 239 o9 
Grade XII ~44 syn AETIB 255 
Total Fess! .45 40 246 


The mean biserial correlation coefficients shown in 
Table VI indicate that the discriminating power of the two 
Forms is Similar, but that here again Form B appears to be 
somewhat superior. 

Biserial correlation coefficients for individual 
items indicate the degree of homogeneity of a given test as 
well as the discriminating power of a given item. Because 
the skill the Poetry Test attempts to measure is perhaps 
more heterogeneous than homogeneous in nature, these 
eoerficients*must—be interpreted with-cares— itis difficult 
to determine, for example, to what extent a low biserial 
Correlation coecrificient for a given item indicates a low 
level of discriminating power and to what extent it indicates 
Poteet ne itemeis measurang a Skili@whiehnmisS di tierencetron 
thatemeasured by the other test items. Therefore, as a 
supplement to the main item analysis, each of the subtests 


imyecach. form was treated as a separate test and a second 


tan eee A 


| = Set : - aaien he 0B 
fyraby ixteeutt eeive anit . a ve, 


i aed A age oe a, oh ie eae joraaeet 


Ft. Gite BE £ 
| | 4e 1s thn) 

ra, ch. ie; i 
d i ite bomk 
ay Oy eis $Gis 1 : 


, new iLwr3ac fo meekd teen en? 


ch treats! IMA 
a ott ida Abeta seedh SS eae ateokhnt 1v oki 
sal’ ‘Ott : i La a eee 7nd cuntiata: of 
stotreqes 
iiaiseyt! . uot elena Leineesh ” 
ap, coat! aerty » ed , 405768: © 
@S3r 5 OOe praak, Tare tge « ce jumitnd pase ond § 


oie ot qn? Jeet Qaee alee 
seals aarzion Reo! note A622 Gare 
Si0ca57t 22 i jniens ieiv ortonmpeatad ed “ae 

“Lad xeued Ol f Weegee PGT, os Lcomegee: ORs. 

wol-c wWites that wie. Ff oe oe cet 94ers inal 
egtesttnt 3k anntee venw 6) ie, SaMOH co ha a 
mike: Frese EL, Exe fir tsi titer» nédsneem an 

‘ 7, - aetetent whe thoe cL sladiad and i 
anna Wt = eens: coidioa 7 


A 6) iE 


item analysis carried out. The results are presented in 
Table VII. CThis procedure resulted in mean biserial 

Socre lau OnycOcimNe ten tSomOtmO). Coe tOrerorm Amand 0.69 for 
Form B. While the small number of variables involved (in 
CEreciumeacCliatest) CONS: sted of only Eouredtems madera 
impossible to compare these mean coefficients with any 
degree of statistical validity? their similarity suggests 


tnat the = two test forms are similar in overall discriminating 


ability: 
ANIL, WAC IL 
Mean Biserial Correlation Coefficients 
Using Subtest Totals 

Mean Biserial Correlations 

for the Four Subtest Items 
Subtest Form A Form 8B 
ZenOught. POD OG 
"Suggestion" 49 al 
SOUT. mere as 
"Rhythm" a 509) 
Total Means (69) egy 


a RS oA CN 


Intercorrelations between total scores and subtest 
scores. Table VIII presents a comparison of intercorrela- 


tions between subtest totals and test totals for the two 


toOuinn McNemar, Psychological Statistics (New York: 
icy, 91962), pp. 39-40. 
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TABLE Wl Or 
Comparison of Intercorrelations between 


POCEry A Leste Oral ocores and 
SubtestsScores for (forms “A ‘and JB 


Subtest Score twisth elotak Score 
Subtest Form 4 Form B 


1. Thought 


Total Group O38 ii 
Grade X 10 noe 
Grade XII ~49 oa 0 


22) Suggestion 


Total Group Os wou 

Grade X Poe oe 

Grade XII A Tak -64 
3. Sound 

Tota Ll] Group ~49 ~74 

Grade X eo 0 

Grade XII Om oue 
4, Rhythm 

wotal Group 200 also} 

Grade X sane ‘62 


Grade XII bo 6 -60 


rr ee 


ANON) 


test forms and for the two grade groups. Generally, these 
intercorrelations are moderately positive, and are similar 
ron themtwo test forms,;. tending) to be slightly higher for 
Form B than for Form A. The presence of markedly lower 
encercorrelativons between the “Sound” and “'Suggestion 
Portals wands test lotals for the Grade x group perhaps 
reflects the relative inability of the Grade X students to 
deal with the items in these two categories--an inability 
which is suggested by results reported elsewhere in this 


chapter: 


Total scores and reading test scores. The correla- 
tions of the total scores on Form A and Form B with the 
Reading Test scores for the total sample, 0.48 and 0.44 
respectively, are presented in Table IX. The similarity 
between these coefficients again suggests that the test 
forms are reasonably comparable. However, the difference 
between these coefficients was tested using Fisher's 
z-transformation technique? and was found to be significant 
Tocheee Ope level. This, together with Lhe fact thateall 
ene cocrficients reported in Table IX are significantly 
Breater than Zero, Suggests that the Poetry Test and the 


Reading Test measure discrete but related abilities. 


ei Pe Cullrord, Fundamental otaulLoeles, PD. lLol- 710. 
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TABLE IX 


Correlations between Poetry Test Scores 
and Reading Test Scores 


a 


Poetry<Test= Scores 


Reading Test Scores Form A Form B 

Total .48% 44% 

Vocabulary subtest hee: PAG * 

Comprehension subtest ~46%* 4 alle 
Gey ce 18) 6h 


A comparison of increases in Poetry Test and Reading 
best performance “of Grade XIi students over Grade X students 
is presented in Table X. The per cent increases for the two 
forms of the Poetry Test and for the Reading Test indicate 
that overall, there is a slightly greater increase in 
Poetry Test performance than in Reading Test performance. 
However, for Form B, which appears on the basis of the 
previously reported data to be the more reliable test form 
for Grade XII students, the Poetry Test increases are 
substantially greater than the Reading Test increases. 

Ehusi May provide, avturther andication: that: the: two tests 
Measure somewhat different abilities, and possibly suggests 
that during the high school, years) there is aj greater gain 
iestudents! responsiveness!.torthesdinguistic subtleties 
embodied in poetic language than in the students' responsive- 


Nees to.the. "normal", ox referential, operation of language. 


CS 


TABLE X 


Comparison of Gain in Performance of 
Grade XII Over Grade X Students on 
the Poetry Test and the Reading Test 


$e SSS iS SS SSE SESE 


Source of Grade X Grade XII Per cent 
Scores Mean Mean Increase 


Poetry Test 
Form A Group Bie) fae! si 


Form B Group Sets) Sie 42 


Reading Test 
Form A Group 6.15.9 87.4 41 


Form B Group 6520 Gr lieray 26 


Sharacteristics of the Four Subtests 


Meanssandestandard deviations of subtest scores. 
Pabies<t—-shows=that. generally there isa fairly high degree 
of similarity between standard deviations both as compared 
among the four subtests in each Test Form and as compared 
between corresponding subtests of Forms A and B. This 
Similarity holds true for the total sample and for both 
grade groups, suggesting that the subtests produced fairly 
Similar dispersions of scores, thus permitting a comparison 
of the mean scores of the four subtests. 

A comparison by inspection of the subtest means of 


the two test forms reveals somewhat greater differences 
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Comparison of Means and Standard Deviations 
Of Subtest Scores 


TABLE XI 


TOTAL SAMPLE 
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Subtest 1 Suptest 2 Sviptestsss Subtest 4 
Thought Suggestion Sound Rhythm 
ReSite HOM Mean SD Mean SD) Mean SH) Mean oD. 
is A rey Sens IR ee Oe eto ace ei ehsy das) 
B PLS AGS OSE a3 S BRS 5 eee el a ele OMe OS 
GRADE X 
Subtest 1 Subtest 2 SuPteSt = 3 Subtest 4 
Thought Suggestion Sound Rhythm 
Test Form Mean So Mean Sye) Mean SD Mean SD 
A bes 5 FOS Bates / -86 A oye’ Oe ine Ow 89 
B He 98 .96 294 Misi eo OS meet eae 99 
GRADE XII 
Subtest: 1 Subtest 2 Subtest 3 Subtest 4 
Thought Suggestion Sound Rhythm 
Test Form Mean S19 Mean SD fean SD Mean SD 
A aha ib mp eh & SEE AHSHS) oS a eae 0 See le oe eee OO 
B Dead SHO IE ag Fah 86 eee Loe ec 0 melee ORE 
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between Forms A and B than is revealed by the comparison of 
total test means presented in Table IV. These differences 
in subtest means provide a further indication that the 

test forms, though roughly comparable, are lacking in 
equivalence. 

A comparison by inspection of Form A subtest means 
with the corresponding Form B subtest means produces a some- 
Wiad Bcequlawepattern trom whichwikt istidiificulit tommake 
eclear-—cut-anferences regarding performance by each of the 
eEaaderGrLoupssonm the jfourtsubtests., WhiiswirregullarityAs 
not unexpected in view of the complexity of the skills 
measured by each subtest and in view of the fact that each 
subtest, consisting as it does of only four items, repre- 
sents a very small sample from a total population of possible 
items. Thus, tne Grade X mean for the Suggestion Subtest of 
Pormss, Lor example, is inexplicably low in relatwvon @o the 
other Form B subtest means for Grade X. 

An inspection of the data presented in Table XI 
suggests that there is a higher degree of similarity between 
thesForm A and B means of three of the four subtests for 
Croce xi L than for Grade xX. This is perhaps due to the 
Mmikelinood that the test items on the whole are too 
GirrvGuliu, andsthererore of questionable mwellability), tox 
Grade X students. 

More central to the purposes of this sstiudy » inowever, 
is the question of the relative difficulty of each of the 


four subtests as it reflects the degree of skill possessed 
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by high school students in the area measured by that sub- 
testy CA true’ comparison of these’ diff Lleys Wevelse re acemust 
be pointed out, is not nossible from t present data 
because mean.scores for the various subtests reflect the 
widely differing difficulty levels of the small number of 
items comprising each’ subtest as much as they do skills of 
the students. Table XII indicates that each subtest con- 
faans BOLneecasyeand@difficuit Ptemss MAEVis clear that the 
mean score for any one subtest could easily be dramatically 
raised or lowered through a change in the selection of 


constituent items. 


TABLE Aut 


Item Difficulty Index Range Within Each 
SsubtesteorVrorms A andep 


POU Sean Form) B 
Subtest Gradenx ) Gradesxil Grade, x) Grade wxil 
ii SPR EAS S) AS 20 aE gl) 
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Nevertheless, because the items comprising the final 
test ant were selected from over four times as many items 
on the basis of their discriminating power rather than their 
Wrrticuicy level, certain inferences concerning the relative 


abilities of students in the areas measured by the subtests 
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appear justified. A clearer if somewhat oversimplified 
PicturesoOt ene relative difiiculties of the four subtests 
is provided by the combined means of the two Test Forms 
peescnted@in Tablegxi. “Ite istgranted that this procedure 
is statistically unsound because the two forms were 
administered toPdirferent groups. iItedoes_ however permit 
eranking Of “thepfourtsubtestsm(showneinefable XIII) from 
which certain generalizations can be made: 

1. Students generally found Subtest One (Thought) 
easier than the other Subtests. 

CAmeovcudents generally found Subtest Four (Rhythm) 
easier than Subtests Two and Three (Suggestion and Sound). 

3. Students in the two grades responded more 
consistently to Form B than to Form A, and thus Form 8 
would appear more generally reliable as a measuring 
instrument. 

The first two of these generalizations corroborate 
Themsceculteeeor the pilot and pre=pilot studies, in which 
students generally found Subtest Two (Suggestion) and 
Subtest Three (Sound) items more difficult than items in 
Subtest One (Thought) and Subtest Four (Rhythm). 

With the forementioned reservations in mind, cer- 
tain other interpretations appear justified from the 
composite data presented in Table XI, which gives the means 
and standard deviations of the four subtest scores on each 


Smectne twoucest. LOrms. 
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TABI ALLE 


Rank Orders of Mean Subtest Scores 
by Test Forms and Grade Groups 


a 


SOurcerVot SuUbtestrl 8Subtest 2 Subtest 3 Subtest 4 
Mean Scores Thought Suggestion Sound Rhythm 
born A yrotal al a 5 4 
Form A Grade X 2 | ib 5) 4 
Form A Grade XI1 1 2 4 3 
PormsBatotal a 4 ¢| 2 
Form B Grade X 1 4 3 2 
Form B Grade XII ik 4 =) 2 
Combined Grade X a Sid BD 2 
Combined Grade XII aL 4 4 2 


Combined Total 1 4 4 2 


11% 


Jom ASaissshownein able XIV, whicheis based onithe 
daboagprmesecuredPingtablesxi, fonlvefoussubtest Ones (Thought) 
Bree tLnieeyncreaseseort=Gradesiliascores over Grademxtscores 
Similargifor thestwo Test Forms’ © For ithe) other subtests 
ehesemincreasesmdifierngsubstantially) forethe “two Test Forms. 
The Subtest Four (Rhythm) increases appear somewhat more 
eonsistentahanethosesiouesubtest) Twoe (Suggestion), andaton 
Subtest Three (Sound), where increases as low as 9 per cent 


and as high as 82 per cent appear. 


TABLE XIV 


Per cent Increases of Mean Scores of Grade XII Over 
Grader weloOLe Cheer Out Subtestcy OLerOrmssAvanadLes 


Grade XII - Grade X 


Increases Grade XII over Grade xX = ———————————- x 100 
Grade X 
Subtest 1 Subtest 2 Subtest 3 Subtest 4 
Thought Suggestion Sound Rhythm 
A 36 20 9 70 
B 22 82 58 28 
Av. 29 56 34 | 49 


2. The data presented in Table XIV indicate that 
the percentage increases of Grade XII scores over Grade X 
scores are generally greater for Subtest Two (Suggestion) 
and Subtest Four (Rhythm) than for Subtest One (Thought) and 
Subtest Three (Sound). This matter bears further study, and 


Pee perhaps accounted for by the fact that Subtest Two 
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(Suggestion) and Subtest Four (Rhythm) relate to special 
technical skills more peculiar to poetry and hence more 
susceptible to short-term improvement than the skills 
measured thyssubtestiOnes(Thought)imand Subtest Three ’(Sound). 
ihe, components smeasuredeby esuptestiOnemithe “thought" for 
OvVero Miaimeaningmot aepocmimandesy Subtest Three (the effects 
of the sounds of individual words) would seem more closely 
melaved toneverydey Mngurstic skills thantthe more 
exclusively poetic components measured by Subtest Two 
(Suggestion) and Subtest Four (Rhythm). 

3. The inferences made in the previous section must 
be viewed with caution since, as shown in Table XI, the 
means for Form B, Subtests Two (Suggestion) and Three 
(Sound), and Form A, Subtest Four (Rhythm), are extremely 
close to the chance level. As noted earlier, the Poetry 
Test, particularly in Subtests Two (Suggestion), Three 
(Sound), send four (Rhythm), appears too aifiicult for most 
Grade X students to produce results having any appreciable 
degree of validity. 

Lteappears, then, that: the Poetry Test was suctess— 
ful only to a limited degree in revealing the relative 
competence of high school students in the areas measured 
by the subtests. The Test appears more suitable for Grade 
XII than for Grades Grtudents end, in ceneral, Porm s 
appears more reliable than Form A. 

Thatelteis cacien to find Consistency anethesreculics 


of the "Thought" Subtest than in the results of the 
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"Suggestion", "Sound", and "Rhythm" Subtests can perhaps be 
aberibureqd tos che *possibs laty thatethes "Thought ta Subtest 
meesuresea More general and*hence stable skill more akin: to 
general reading comprehension than the skills measured by 
the other subtests, which deal with uses of language more 
pecultar to poetic communication. 

Thewitreqularityreorethe pattern Gf results produced 
by the (suggestion end #@Sound”™ Subtests and to a lesser 
extene the BRhythm= Subtest as not unexpected in the laght 
of the comments regarding complexity of poetic language 
eeviewed "in Ghapter gael and sthe difticultyein categonization 


describediin Ghapter 11. 


LEemucaLa snot tne seOln subtests alt mesSeCELOn OL 
fapley XV which gaves the, mean itempdiifticulty indices for 
each of the four subtests presents substantially the same 
data as 1S given in Table XI. Because” each subtest 'con-— 
Srsts Of sfOUr items, multiplying) the item duiticulty 
induces by LOur produces: roughly) the meanesubtes: Scores 
found in Table XI. These data have been discussed in the 
previous section and hence require no further comment at 
this point. 

An examination Of the second section@of Tablerxy, 
which presents the mean biserial correlation coefficients 
for the four subtests in each Test Form, reveals that the 
overall discriminating power of each of the four subtests 


is about the same as that of the total test. Consistent 
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with the data for the total Test Forms presented in Table II, 
there is a markedly greater increase in biserial correlation 
coefficients of Grade XII over Grade X for Form B than for 
Form A on all four subtests. These data appear to supply 
evidence Sthaterorm Baus ¥superior to Form mot "only “in 
overall discriminating power but also in the discriminating 
power of each of the four subtests. 

The *second' sections of lable “XV further indicates 
that ; *with*the exception of “Subtest “One (Thought); ‘the 
subtest results confirm the generalization proposed earlier 
that the test items as a whole have more discriminating 
power for Grade XII than for Grade X students, and that the 
mestedappears more reliable tor Grade, Xii “than for Grade, xX. 

The third section of Table XV presents the mean 
item reliability indices for the four subtests of each Test 
Form. Unless the item difficulty index for an item deviates 
widely from the 0.5 level, the item reliability is closely 
related to the biserial correlation coefrrcient., Thus the 
data presented in this section confirm the similarity of the 
mean item discriminating power of the four subtests shown in 
Bectlonetwouor the table.  [t would appear that with, the 
possible exception of "Suggestion" the Poetry Test as a 
Wiclerwais etary successoulein terms Obethe simi lanicy sot 
the mean item discriminating power of the four subtests in 
each Of the two Forms. 

Table VII (page 101) presents item data obtained by 


determining the correlations between performance on 
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individual items and subtest performance. As was noted 
earlier, the value of this procedure is curtailed by the 
small number of items in each subtest, making the biserial 
correlation coefficients and hence these item reliability 
indices spuriously high. This procedure, however, does 
provide data which corroborates that presented in Table XV. 
Again, with the possible exception of "Suggestion", a com- 
parison of the figures both across the subtests and across 
LNeeEwO, Leste forms reveals a high) degree of similarity. it as 
theretore possibie to produce items Of similar discriminating 
ability for each of the four subtests or categories. In this 


respect the present testing procedure appears practicable. 


Intercorrelations among subtest scores. Intercorre- 
lations among the four subtest scores were computed in an 
attempt to discover the extent to which the skills measured 
by the subtests are related to one another and possible 
patterns of relationships between the skills measured by the 
subtests. 

Table XVI reveals that over-all, the intercorrelations 
among subtest scores are positive but low, suggesting that the 
skills measured by the subtests, while interrelated to some 
extent, are highly discrete. As shown in the table, EOL=bOtn 
theatotal Group andythe Grade, XIl group a posative correla= 
tion significantly different from zero occurs in seven out of 
twelve cases, while for the Grade X group no significant 
correlations occur. The table also shows that significant 


positive correlations occur five times for Form B and only 
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TABLE XVI 


Intercorrelations Among Subtest 
PCOLrestOrelr ors” andlBs 


Ssubcestel evan 2 Subtest 3 
Thought Suggestion Sound 
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TOTAL GROUP 

Subtest 1 
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twice for Form A. 

Byaiconverting. Coertiucients to standard scores, it is 
possible to average two or more correlation coefficients.+ 
As estimated by using this procedure, the correlations 
between all pairs of subtests of the Poetry Test Forms average 
less than 0.20 while the intercorrelations between scores on 
the two subtests of the Nelson-Denny Standardized Reading Test 
average over 0260. —Thussthere appears to besa substantially 
lower degree of relationship between the component skills 
measured by the present Poetry Test than between skill in 
Vocabulary and Reading Comprehension as measured by the 
Nelson-Denny Test. This suggests that possibly the complex 
Gpaski bls comprising «the i;onstruct "Skill in Responding to 
Poetic Language" which the experimental test seeks to measure 
is more diversified and complicated than what is usually 
thought of as General Reading Ability. These findings appear 
to lend support to the views expressed in previous chapters 
Trecardangmtne relative. complexity, Of poetic language. 

Further examination of Table XVI reveals wide 
Gifferences between the various inter-subtest correlations 
Forme Giceuvomeornc. wiinisecet Lectcmthnesdlererencesmine tie 
Gorrelations between the subtest scores and total scores 
presented in Table VIII (page 102) and substantiates the 
uc ticn beLeculmecategorization discussed tin Chapter [ik 
The present categorization scheme appears to be somewhat 
inadequate for coping with the complexities of poetic language 
and would seem to require further refinement and modification. 


touinn McNemar, Psychological Statistics (New York: 
Waikey, 1962, p. 140. 
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Burther,) cine arregqularity of the pattern of intercorrelations 
Seen in Table XVI makes it difficult to formulate clear 
generalizations regarding the relationships between the 
various skills measured by the four subtests. Nevertheless, 
certain interpretations seem warranted on a tentative basis: 

iy AS Table -xVIl, which is a supplement to Tabie 
XVI, clearly shows, mean intercorrelations, as estimated by 
the z-transformation procedure, are much higher for the 
Grade XiIl group than for the Grade K group. More specifi-— 
cally, many of the intercorrelations for the Grade X group 
are either very low or negative and their average is close to 
zero. This is perhaps best accountable by the fact that the 
Grade X means are close to the chance level. This result, in 
addition to indicating the limited suitability of the test as 
a whole for Grade X students, would seem to cast considerable 
doubt on the significance of the statistical material and 
inferences based on Grade X data. For this reason the sub- 
sequent generalizations are based mainly on the Grade XII 
intercorrelations. 

2m Tab leuxyin -alscosreveals=thatersore tne lLOtal= sample 
orig == Oca themcrade= x1 lf groupetnes estimated average inter— 
Slnbtest eerrelacioneic substantially higher*@ilonrrorm Bethan 
for Form A. This appears to reflect the higher mean subtest 
scores presented in Table XI (page 106) and probably the 
Boreacer reliability of Form B indicated by the data in 


Table I (page 93). 
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TABLE XVII 


Ls 
Mean Intercorrelations among the Four Subtests 
by Grade Groups and Test Forms 


Form 
A B Means 
Total a5 72 OU Spal 
Grade X 8h! ny Oe} -04 
Grade <i P15 042 ** Sis 
Grade Means .09 S20 ey, 
*p < 0.05 
cle fo) OMOul 


3. From the data presented in Table XVI for the 


Grade XII group, the highest intercorrelations are between 


Subtests One ("Thought") and Two ("Suggestion") and between 
Subtests Two and Three ("Sound"), while the lowest are 
between Subtests One and Four ("Rhythm"). The considerable 


difference between the correlations found in the Test Forms 
agrees with what might be expected in view of the nature of 
the skills measured by the subtests. 

te seems reasonable, for example, to expect that the 
skill measured by Subtest One, which has to do with the 
Polain sense meaning Gf a poem or part of a poem, will bear 
mecloser relationship to skill measured by Subtest Iwo, 
Moiche has toldo wilth=the "poetic", or suggestive, meaning 
Of a word or expression as it relates to its context than 


lAs estimated by means of the z-transformation 
technique (see McNemar, loc. cit.). 
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it will to the skill measured by Subtest Four, which has to 
do with sensitivity to poetic rhythms. 

It also seems reasonable to expect that the skill 
measured by Subtest Three, sensitivity to the non-rhythmical 
sounds of individual words and expressions, will bear a 
closer relationship to the skill measured by Subtest» Two 
("Suggestion"), because the suggestive power of a word is 
Berni onced py 1Cs sound, than it will to the ck111. measured 
by Subtest One ("Thought"). All of the foregoing expecta- 
tions are borne out to some degree by the Grade XII data. 

There is, however, one possible expectation which is 
not supported by the data presented in Table XVI. This is 
the expectation that there would be a relatively high 
correlation between Subtest Three ("Sound") and Subtest Four 
("Rhythm") since each measures sensitivity to a kind of 
Ward-SOuUnd. —ACCOrding Lo the findings of this) study, 
sensitivity to the sounds made by words appears to be a 
complex of fairly discrete skills rather than a single skill. 
This relationship bears further investigation. 

In summary, the patterns of relationships between 
Pieuskills measured by the four subtests are only dimly 
revealed by the present study. This is an exploratory type 
of investigation which not unexpectedly, in view of the 
DEO PesccyeGe poetic language, failed to produce an instru- 
ment sharply enough defined to distinguish clearly among 
the various skills the subtests attempt to measure. The 


study does, however, provide some direction for further 
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investigation. This matter will be discussed further in 


Chapter VI. 


Comparison of subtest scores with reading scores. 
Table XVIII presents the intercorrelations between each of 
theesubtestyscores/of the twosPoeétry Test “forms wand the 
three Reading Test scores. Again differences between data 
produced by the two Forms and the irregular pattern, 
Parerculaniyein thevGrade’X data; make itfdifficult to forum 
clear interpretations. 

The data presented earlier (Table IX, page 104) 
showing low-positive correlations between totals of both 
Poetry Test forms and Reading Test totals suggest that the 
two tests measure related but reasonably discrete abilities. 
Because a central concern of this study is te examine the 
difference between response to discursive language and 
response to poetic language, or in other words, between 
skill in "reading comprehension" as it is normally measured, 
and skill in reading a poem, the intercorrelations among 
the four Poetry Subtests and three Reading Subtests are 
examined in some detail. 

Of ‘the total of 72 intercorrelations presented ain 
Pa eoex Vii oo Orsi chtly more: than halt sare ssiom. te 
Paitiv alererent irom zero.  ©Of these 397,20) resutesrrom 
Form A and 19 from Form B, suggesting that overall, the 
two test forms bear a similar relationship to the Reading 


Test. Also similar are the data from the two Grade-Groups: 
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TABEE AVITEL 


Intercorrelations of Subtest Scores 
and Reading Test Scores 


SUDtCeESt eeu DLeSst Subtectes Subtest 4 


Thought Suggestion Sound Rhythm 
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PorevOCheGCrale. Kang Grados lie aleolkL Ot a totalaore 24 
SOrreiations are Significan: Ilyyaciwererent. trom zero.) Thus 
the overall relationship between Reading Test performance 
and Poetry test performance appears to be approximately the 
same for Grade X and Grade XII students. 

An examination of the intercorrelations for the 
individual Poetry Test subtests, however, reveals certain 
important disparities. As Table XIX which is derived from 
the Table XVIII data clearly shows, for the total sample, 
performance on the "Rhythm" Subtest correlates the most 
highly with Reading Test performance, while performance on 
the "Sound" Subtest correlates the least highly with Reading 


Test performance. 


TABLE XIX 


pignitteant) Intercorrelacions between Poetry 
Subtest Scores and Reading Test Scores 


Numbemsmomolgqntiiicane Correlations 
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For the Grade X group, very low correlations appear 
for Form B scores, ‘particularly those for Comprehension and 
cnose fOr Subtest. Two ("Suggestion )= = ror Grade xi the 
intercorrelations for Form B are somewhat higher than those 
TODerOrm Ay, except for the Sudgestion Subtest. “The 
"Thought" and "Rhythm" Subtests correlate more highly with 
Reading Test scores than do scores on the "Suggestion" and 
resound” Subtests:. 

Certain inferences and explanations consistent with 
these data provide further evidence that Forms A and B are 
not equivalent. It has been tentatively concluded that, 
because Grade X scores are often very close to chance level, 
Grade XII results are more reliable. It has also been 
tentatively concluded from the item data that Form B is 
more reliable as a source of inferences than Form A. An 
examination of the Grade XII scores, particularly those for 
Form B, reveals that performance on Subtest Four ("Rhythm") 
correlates more highly with Reading Test scores than does 
performance on the other subtests. This correlation is 
followed farriy closely by “Subtest™One™ (“Thougnt, ), “with 
much lower correlations for Subtests Two ("Suggestion") and 
Bisecw(. Sound"). 6 [he correlation  cOeCTIICIeENnts  2Or@ecub tes cs 
POUL One eel iree, ana lwo,8 are 0.00, 0.4/,.0.15,7 ande0.07 
Beene anaes Mem last tWwOsdre Tol salon tecantl y= dierenent 
from zero. 

Dneexanination of Table Nix end the figures on 


Table XVII on which it is based reveals a pronounced pattern 
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in performance on the "Suggestion" and "Sound" subtests of 
BOLtiseAmentebnrOr swhicherterssdiibiculs totaccount. 
Pecordingutoerchiscppatternaior both Crade xXfandiGrade =xt1 
students there is a significant relationship between scores 
on Subtest Two ("Suggestion") of Form A and Reading Test 
scores and virtually no relationship between scores on 
SUubecestelwOo,Ol Form Brand Reading Test scores. For Subtest 
Three ("Sound") this pattern is exactly reversed: Form B 
SCOMeS are Signitacantlysrelated and Form A scores 
unrelated to Reading Test scores. 

A close investigation of the relevant items and an 
BerciptLe tO relate this pattern to the factor Joadings 
fMascussed in a later section failed to account for this 
Percent Can Onlyaberattrloured [oO the possibiiity, 
that because of the very small sample of items in each 
subtest and the complexity of the skills being measured, 
the four items in Subtest Two Form A and the four items in 
subtest Three Form B unintentionally measure, to a sub- 
Seantial degree, skills common to’ all readings) Conversely, 
wieappears that the four items in Subtest’ Two) Form Buand 
Bnew cOoureitemsein Subtest Three Form -A unwittingly measure 
Beeulsemore 1 d1osyncratac either to the test itseli om co 
poetic language in general. 

Another pattern is revealed by the figures presented 
Mmerabvesx<, which is @also derivéd from Table "xXVIIP™ There 
Pemeomemindication here thaterorm A items generally operate 


more at the poem's total meaning level, while Form B items 
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operate more at the single-word-meaning level. Because the 
intention of the test was to stress the latter and because 
most. of thes data® presentedtto this! point suggest that’ Boas 
EnesmMoremsuccessf£uly form inetermsiof this intentions! the 


pattern suggested by Table XIX is not unexpected. 


TABLE (Ax 


Significant Intercorrelations between Reading 
subtest Scores and Poetry Test Scores 


NUMDer VOL Totontircant COLLelalitone 
fOr Reading Subtests (out or 12) 


Roce Lect, horm Vocabulary Comprehension 
A S | 
B 8 4 


A further anomaly revealed by Table XVIII is 
presented in simplified form in Table XXI. For both Subtest 
One ("Thought") and Subtest Four ("Rhythm") there is a 
noticeable Grade X-Grade XII increase in Poetry Test-Reading 
Test intercorrelations for Form B. Conversely, there is a 
SeLlLesponding decrease for Form A. in the case of Subtest 
SnemGeThouchte. ) thiswirregularity is perhaps dueito che 
Pectethat three of the four Form A items were notably 
unsuccessful in requiring students to make inferences about 
thew thought" of a poem. With regard to Subtest Four 
("Rhythm"), an explanation appears to be that the Form B 


items tended to stress the metrical pattern of the whole 
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poem while the Form A items tended to involve metrical 

nuances within individual lines. Thus the Form B "Rhythm" 
items probably measured a skill more analytical, and hence 
more Closelysrelated to “reading comprehension", than the 


corresponding Form A items. 


TABLE XXI 
Intercorrelations between Reading Test 


scores.and Scores on Subtests One 
and Four by Grade Level 


Subtesc. | Subtest 4 


Thought Rhythm 
Grade Level Form AW Form 5 Forms Form +s 
x A Oe A OLE mel aie 
xr us ele a PAS -60 


Of the skills measured by the four subtests, that 
measured by Subtest One, which attempted to deal with the 
eenougit. Or "overall meaning “of a poem, might have been 
expected to correlate the most highly with the skills 
measured by a standardized reading test. Contrary to 
expectation, this skill correlated less highly with Reading 
Pest escores  thanedid the skill measured by Subtest Four for 
ele, Grade l2 group, and correlated the least highly of all 
with subtest scores with Reading Test scores for the Grade 
X group. 


It would therefore appear that the kind of reading 
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skill measured by Subtest One ("Thought") is different from 
general reading skill as measured by standardized reading 
tests. This difference has a tendency to diminish with 
older students. 

theegenerally lowscradesxtiecorrelations sfor iSubtests 
Two ("Suggestion") and Three ("Sound") may be explained by 
suggesting that these subtests measure skills largely 
mOroOsyNCraticetompoctic language wevilt @isemore tdi tffiicult, 
nowever,=tovexplain®the relativelychigh correlations between 
Subtest Four ("Rhythm") results and Reading Test results. 
Hpwould seem™*that Subtest Four, lake Subtests ,Twovand 
Three, measures something more or less peculiar to poetic 
Henguages(Enyihmn-andemetre)*emOnethewrace Of TE, eariow 
correlation would be expected here. Perhaps the relatively 
high correlations may result from a common skill, somewhat 
Bool ycilcal sdlenigcures, swhich@underiaes bothvabaliityato 
discern a metrical pattern and to succeed in a standardized 
reading test. ~The’ factor analysis results presented tiater 
in this chapter: as well as® the interview results presented 
in chapter V, tend to bear out this possibility, which 
appears a fruitful avenue for further study. 

DPeinatyehighly tentativesconclusiontanisingetcoem 
the data presented in Table XVIII has to do with a compari- 
son of Gade YeanemoGraccmx) le CcOcriacLents [orm the four 
subtests. This comparison reveals a substantial general 
gain between Grade X and Grade XII in performance on subtests 


One and Four, a small gain in performance on Subtest Two, 
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and no gain in performance on Subtest Three. A possible 
explanation is that, like the Reading Test, Subtests One, 
Two and Three measure skills more capable of fuller develop- 
ment during adolescence than is sensitivity, to<thesflavour 
and, SOUNdS OCfawords. ~sThus tLheshighest correlations in 
Bat Cav lil sane betweensthe Vocabulary ysection orethe 
Beading .lest_and Subtest Four ("Rhythm"), both .of which 
measure skills capable of rapid development, and the lowest 
correlations, at, least for the Grade XII group, are between 
Reading scores and Subtest Three ("Sound") scores. 
Apparently sensitivity to word sounds does not, like skills 
measured by Subtests One, Two, and Four, become more 
closely related to general reading skill, as measured by a 
standardized reading test, as students mature. Perhaps 
this points to a deficiency in standardized reading tests, 
and suggests their neglect of certain kinds of word 
meanings connected with nuance and sound. There seems 
little doubt that this matter requires further investigation. 
Finally, it appears that the anomalies revealed in 
Maes 4X10, soa ond Kl pein, Getying Jeasy sinterpretation, 
provide further evidence that each Subtest and indeed each 
item of the Poetry Test does not measure a single simple 
SembieebiGerather eauacomo.lex,ot skadke which isso siculc tO 


analyze on the basis of the present data. 


Summary of Characteristics of Test Forms and Subtests 


Before proceeding to report in some detail on 
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performance on individual Poetry Test items, it seems useful 
Loepresen td Drier review Of the=main findings reoorted enus 
far. These findings, which relate to the Test Forms as a 
whole and to the Four Subtests, are presented as follows: 

Ll. in view of the high degree of complexity of the 
Sito oeindemeasuLrea, alids in view Of LtS DUrpOSses as an 
investigating instrument (see Guilford's comment on page 96) 
PiemrocirLy Lest Was TOund, CO-pe satisfactorily reliable. 

2. The two test forms were found to be comparable, 
Dutewebe NOL found to meet Standards for Sstatistacal 
parallelism acknowledged by current authorities on testing. 
This lack of equivalence is particularly evident in 
comparing the difficulty levels and discriminating power 
between each of the four pairs of subtests. 

3. Most of the data suggests that Form B is 
generally more reliable than Form A. 

4, The Poetry Test generally appears more reliable 
HOmeGradew, lL students than cor Grade x Students. “Also; in 
terms of difficulty, the Poetry Test is considerably more 
Ssurteable for Grade Xi than for Grade xX Students. 

be oubtest One we lnough. ) results and oubvese 
Four ("Rhythm") results show a more consistent performance 
pattern than do Subtest Two ("Suggestion") and Subtest 
mnree ("Sound") results’. 

6. Of the four subtests, Subtest One ("Thought") 
was generally the least difficult, and Subtests Two 


("Suggestion") and Three ("Sound") were generally the most 
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7. There was a greater performance increase between 
Grades X and XII with Subtests Two and Four than with 
Subtests One and Three. 

8. The mean item discriminatory power is approxi- 
mately the same for the four subtests and for the two test 
forms. 

9. Ihere is generally a low level of intercorrela- 
tion among scores on the four subtests (mean correlations 
fmuncl)}. ineedegree Of intercorrelation is Nigher for the 


Grace “ii Stuaents than for the Grade x Students. 


10. The correlations between performance on Subtests 
One ("Thought") and Two ("Suggestion") and between Subtests 
fwo and Three ("Sound") are relatively high; the correla— 


tion between performance on Subtests Three and Four 
eeoychm ) as relatively low. 

11. There is a low positive correlation between Poetry 
Test performance and Reading Test performance. This correla- 
tion is approximately the same for Grade X and Grade XII. 

12° For Form B, which evidence suggests is the more 
metrable of the two Poetry Test forms, the diafiference between 
Grade X and Grade XII performance appears to be greater for 
Poetry Test scores than for Reading Test scores. 

Mee Generally, perrormance on the “Rhythm” subtest 
has the highest correlation and performance on the "Sound" 
Subtest the lowest correlation with Reading Test performance. 


There is also a relatively low degree of correlation between 
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performance on the "Suggestion" Subtest and performance on 
the Reading Test. 

14. The correlations between performance in the four 
subtests and the Reading Test generally increased from 
Grade X to Grade XII. Of these, the smallest increase is 


ROi@atie. sCOlUNCe soubtest. 


Characteristics Ore individual items 


Complereoricem data ©orerorms Asana 8. Tables oxi. 
Sender. tiopresent, theicriiticulty indicec,-biserial, correla 
erOonecOCLEVvCients, and 1tem reliability indices of all items 
Gneooch Test Honms. Much of this material has been 
Summarized inslables 1, Vi, ViG, IX, and XV and discussed 
in the two previous sections. However, summary data 
involving means of groups of items can fail to reveal 
Specieic Characteristics of individual “tems. 

Cuittord points (oul hate 1k 1S More important, to 
analyze aptitude tests than achievement tests," and that 
"in achievement tests it is sometimes more important to 
have the items approved by a subject matter expert than to 
Know their correlation with the Gtotal scores Because the 
present test is as much an achievement as an aptitude test, 
it would perhaps not seem reasonable to apply item analysis 
Criteria too rigorously, particularly in cases where it 
conflicts with the judgment of the investigator and the 
judges. The present test, in attempting to measure skill 


"ibe P. Guilford, Fundamental Statistics in Psychology 
and Education (New York: McGraw-Hill, 1965), p. 446. 
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TABLE XXII 


Comparison of Item Data for Grade X and XII 
by Subtests for Form A 


Item DIEFELCULeY, Biserval Corr. Item Rel. Index 
Number Go. & Ge, wii Gia Gio. ol Cm 2) Grae oie 
are ee ee a eS I ee ee 


SUBTEoOT Ll: THOUGHT 


AER SERS} eo, <o2 « 2 a6 
aes aie 84 a 05 236 02 
LEO 203 woo a Sit eyes oF aah 
it marl BINS: SOP, sey) ~26 226 
Means 239 oi Belt -49 oo 23 eG 
SUBTEST 2: SUGGESTION 
4 ~49 -46 AV AS ss, wes 307 
AAS) Ben) Bey ak ~o4 -09 25 
2 See) -48 Sie) gals eed a2.8 
es 30 228 -06 26 Oe mie 
Means ol ec 25 ork e0 sate 
SUBTEST a: SOUND 
244 .80 56 soo 525 24 
245 aS 62 E50 suk 28 
229 -48 30 49 «a e24 
14 MOG 09 Ag) oe .06 a5 
Means -oG a6 .43 -48 Lo 20 
SUBTEST 4; RHYTHM 
aye oy 37 aud, 5s) 2S 
nA) oon Pe) Be) » ba Bal: 
13 at G ~50 ~46 .60 Paha 228 
16 eG les) 32 22 eed cra 
Means sa6 742 39 43 16 a 


Eee 


Comparison ofpttem=pata, tor Grade xX. and, Xi 
by Subtests for Form B 


2B oe 


13D 


Item Origin yeyy dlRey, BisecilLal. Corr, Item Rel. Index 
Number Gree ce, Greed. Se Uke eae Se Gre Ne WGre nT 
SUBTEST © ls THOUGHT 

565 -66 -46 B52 Ze 725 

oa] yoy aE) CG .08 2S 

3 Ow 5 - 46 pay o22 5 PAS} 
dns) sae -49 Sy) eee CAG eel 

Means .49 OA. 36 “eayal ay .24 
SUBTEST 2: SUGGESTION 

5 PN) ork ane) coral Sa £35 
ORG] Ag ayy Fou 25 eos 
ital ae 745 .48 iil: ORR, 6 
16 739 .44 2a2 oOo oes Agee 

Means Pou ~47 ~49 OZ mae ee 

SUBTERS. 3: SOUND 
v6 ac -40 a Tpal eS a4 
nas 55 ale oS Z0G ake) 
1) 94 -08 a8 r3i2 eS .09 20 
eS a26 - 46 PAs} es) BAe, ayaa 

Means 4 RE Bae. PAs 44 LO 2 
SUBTEST 4; RHYTHM 

4 70D .64 Ad HSK) p23 04) 
hy #5 49/8) 5 eps 43 220 e200 
LO -49 noe paek ae [20 20 
14 .08 ey Aras 84 .09 32 

Means AS bs 42 56 19 25 
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in responding to poetic language, deals with a complex of 
Skullseoneaniiaities Srather sthanga single skill orvabidity. 
IN@Les consumuc Gilonmaccordingmto: thevcategortessreported in 
Chapter III, the test acknowledges this heterogeneity. 

Thus, useful as item analysis data may be in helping 
the test maker select suitable items, it needs to be inter- 
preted endlapplved with a’ certainsmeasure of flexibi licyein 
RNGwOCeSCnL ec Lucy stems switche during thesprlot studied 
showed a diftirculty andex of Wessethan 0.30 or more than 
0.70. wene Tor themes! part discarded. Similarly, items 
With a biserral correlation coefficient of Jess than 0.35 
were generally discarded. As Table XXIV shows, many items 
as administered to the Grade X group and several items as 
administered to the Grade XII group failed to meet even 
these reasonably flexible criteria in the final test 
administration., Table XXIV provides further evidence that 
the Poetry Test as a whole is more suitable for Grade XII 
than for Grade X students. The two Test Forms are fairly 
Silat tiesdiccermboueron Ofmiitens (by di tilculeyssleved 
end discriminatory ability although Form B has somewhat 
greater discriminatory power at the Grade XII level than 
Form A. 

In presenting thesrange of 1tem data Eagures for the 
Our Siler im-each ftoom, Tables xii “(pagers i108) “and xxv 
Mmidvcaterthe extenteto which individual 2tems deviated from 
PMiemdesirea ait ficulty ana discrimination eievels.. Table 


XII (page 108) shows items in all subtests except Subtest 
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TABLE XXIV 


Range of Biserial Correlation Coefficients of 
TLems within Hach’ Subtest of Forms A and B 


. Grade X Grade exit 
Subtest A B A B 
Al -2/-.84 A SIS ~05-.59 eae 
2 -06-.38 Aa), .t3=.56 BS a Safe 
s w2o=.56 ~i2-.40 2 36—=.56 Sob heros (Ese 
4 -30-.46 DSP ego & SPA a 8) -41-.84 
TABLED KXV 


Distribution of Items by Difficulty Level and 
Discriminatory Power Number of Items out of 16 


i 


Grade and Ditircualiyvaindex Biserial Correl. 
Test Form W0= 60M C0 0 rr ope he eras 
XA 3 5 Se 4 7 1S) 
X B 4 8 13 2 ike 14 
ileL we 8 eat 14 6 el) 14 
alae ‘ 8 ee. 1s) 10 14 16 
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One ("Thought™) as falling outside the desired difficulty 
range. Table XXIV shows all subtests excepting possibly 
subtest Four ("Rhythm")-as including at least one item with 
an extremely low biserial correlation coefficient. 
Thespurposevot Wable XVI Hiss to amdaicate the extent 
pomwnicn Gitticulty indices and biserial correlation 
coefficients changed for identical items between the pilot 
study and the final test administration. Four items from 
each test form were sejected to illustrate the substantial 
changes in both difficulty level and discriminating power. 
Approximately half the items in each form showed substantial 
changes of this nature. Although these changes could 
perhaps have been minimized by using a larger sample for 
the pilot study (only two classes were used), the compari- 
son presented in Table XXVI points out the difficulty of 
creating two equivalent test torms. This comparison also 
raises doubts as to whether the mode of questioning 
developed for the present experimental test lends itself to 
mEesUthicient degree of reliability to render such a test 
useful as an evaluative as opposed to a heuristic or 
esearch instrument. More research involving the refinement 
@~f the questioning technique and the administration of the 
items to larger and more diverse groups would seem to be 
necessary before more definite conclusions can be reached 
Mmecivs matter. The skills which these items attempt to 
measure appear to be highly complex, involving so many 


Variables that even minute changes in the form of an item 
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TABLE XXVI 


Comparison of Item Data from the Pilot Study 
ana “trom the Final Test Administration for 
Selected Items from Forms A and B 


ee 


Item Difficulty Biseula le Corn. 
item No. Pa Loe Pn poe 8! Pulotw ee icles 
FORM A ITEMS 

2 ow 6 all ou oe, 
4 Fai) aul 46 a 
5 0 34 OD ~42 
7 7oG 234 pret) -41 
8 78 46 “ET Dal 
10 Sire sO ay Su 
3 2U Bre 3) Re) 


14 Rae 07 45 ane 
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TABLE XXVI (Continued 


bteneDiLEt icuity, Bisevia il Comr., 
Item No. Pilotweerane | =p Polo rings 
FORM B ITEMS 
Bs eo - 66 224 -48 
5 43 pee ens) 09 
i, «70 60 70.0 44 
8 43 38 34 70 
9 yeas: 36 ok 56 
10 niles eo0 co 45 
He 47 30 395 <o7/ 
14 -40 les [56 ApS 


15 223 sis. ay, 46 
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can produce substantial changes in the item data. 


Detailed examination of response patterns for 
selected items. It was felt that the reporting of the 
results would be incomplete without some type of detailed 
examination of data relating to individual items. This kind 
of examination promises to provide information about the 
ways different sorts of pupils respond to items and about 
Ene Ways clignt changes in the form of atems result in 
substantial changes in response patterns--information not 
paeduatelyiprovided by statistics relating to groups of 
items alone. From this type of detailed information two 
kinds of inferences can arise: those concerning further 
directions for the construction of this general type of 
item, and those concerning specific student response to 
eerraln Specific poetic stimuliz 

Because of considerations of time and space, only 
lhUueGte thes sJ tems comprising both test forms have been 
selected for detailed discussion. This selection was 
difficult and of necessity somewhat arbitrary because all 
Gethe veems usea on thes final test and? many used in=the 
pilot tests are amenable to the same kind of examination. 
Moeimportant consideration in the selection of the following 
Eomeitems was an effort to reflect the various aspects of 
poetic language the test attempted to measure such as tone, 
rhythm, and imagery. Consequently, the following examina- 


tion is organized according to these aspects of poetic 
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meaning. 
(1) Tone 

The "tone" of a poem has been defined by Richards as 
the manner in which the poet's language reflects his attitude 
toward his reader.* Ay perhaps smore satistactory definition 
Poe Ven Dyer ernine:s @' Tone, sin 13 teracure,»may be defined 
as the writer's attitude toward his subject, his audience, 
mOdei@imselie.) bt 1s the emotional Colouring or the emotional 


meaning of the work." 


Obviously, the student's responsive- 
ness to this "emotional meaning" is essential to the right 
reading of a poem. As Perrine and others have noted, however, 
while it is relatively easy to interpret tone in spoken 
Penquage, the correct determination of tone in literature, 
which is indicated by a complex combination of elements 
Sveimas CONNOGaAtION, Amagery, 17,0ny, xhythm, and syntax, 1Sea 
far more difficult matter, and depends on a high degree of 
familiarity with all of these elements. Thus Pin 
Piespresent test, although it was considered necessary to 
mmeiude 'toney 2tems, at was Gitficult to place such items 
imdereany One wor tiie four existing categories. The most 
appropriate seemed to be Category Two, "Suggestion". 


Two ot the Poetry Test items attempted to measure 


SEMNaCecnhcS sawareness Of 'tone™” : In each of these items 


noe Ae Richards, eractical Criticism (New York: 
Pamcounte, Brace’, BLI29)*p tp welk/ 557 Loy: 
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(‘Portrait VIII" and "The Rich Man") an attempt was made to 
vary the distractors mainly on the "tone" dimension, keeping 
other elements such as "plain sense meaning" and metre as 


constant as possible. 


(a) "The Rich Man" 

Table XXVII presents detailed item data for Item 8 
PLOMpr OFM IGte the minal, test... To facilitate interpretation 
the entire item is included in the table. 

In this table and in the nine succeeding tables the 
Maine figures LO note, aside from the difficulty indices and 
the biserial correlation coefficients, are those giving the 
per cent of the total number of respondents selecting each 
alternative (given by the figures to the right of "Total") 
and the test score means of students selecting each alterna- 
tive. For example, of the 96 students answering Item B-8, 
53 per cent selected alternative two, the correct answer 
(indicated by an asterisk), and 27 per cent selected alter- 
native three. The mean Poetry Test score achieved by the 
Deeper cent selecting the correct answer was 8; for the 27 
per cent selecting alternative three, 1t was 5.5. Table 
XXVII also presents a breakdown of the total responding 
Maouve ot 96 students into fitths. The number “5% under 
"Selecting Group" refers to the twenty per cent of the 
examinees obtaining the highest test scores; "4" refers to 
the next twenty per cent, and so on down to AGE og Aidlalsolny 


refers to the twenty per cent obtaining the lowest 
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TABLE ex XV. St 


Detailed Item Data for Item B-gt 


The rich man has his motor car, 
His country and his town estate. 
HevsMokes a Cirey-cenc, cigar 
and jeers at Fate. 


He frivols through the livelong day, 

He knows not Poverty her pinch. 

His lot seems light, his heart seems gay, 
He has a cinch. 


Yet thought my lamp burns low and dim, 
Though I must slave for livelihood - 
Think you that IT would change with him? 


1c Welw Sil we COlLd: 
Ze. YOu bet Mwould!* 
SEC 1eloh) aie ele devel bl irets 
eee tel laewol cs. 
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* = correct response 
Series 1 Pied Cilla. oS Bisebla lL eConr oS 
Selecting % Choosing Alternatives 
Group if gM 3 

Total 07 Bel 27 10 

5 14 86 0 

4 50 

53 67 

a 13 50 25 ses} 

ih 0 14 3 29 
Total Means Chee owe S55) 4.7 

1p, Poe Adams, "The Rich Man," 1m Sound vand Sense, 

ed. Laurence Perrine (New York: Harcourt, Brace and World, 


Peso) Dp. 40. 
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Pilot Dapeuvcul tyes Biserial Gorn. s.o4 
Selecting % Choosing Alternatives 
Group ul Re 3 
Total 20 43 27 10 
5 G oft 14 14 
4 38 33 33 0 
3 30 30 30 10 
2 38 67 0 0 
1 14 20 43 14 
Total Means 8 eal sea 8.6 Loses 
Paniad.—Total 
Group Pater Pout y eo 6 Ba cer Va UsCOGr amt 
Total 18 38 26 18 
3 06 88 0 06 
4 14 36 4 36 
3 06 63 25 06 
2 26 19 35 uy) 
i. 29 0 47 24 
felicia 
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TABLE XXVII (Continued) 


Final - Grade X Dist Circini tye 6 BiserialaCounes. 70 
Selecting %$ Choosing Alternatives 
Group ] an, 3 

Total 2 24 2a 24 

5 25 38 0 38 

4 0 63 25 13 

& 36 14 36 38 

2 0 25 38 Pan|, 

ue 36 0 36 ZT 
Total Means 5 go eee Soil Sree 
Final - Grade XII Di Sieve cys stow Buser ral Conmee) 0 
Total Lb 51 a! uy 

5 0 89 0 Ree 

4 ney, 58 

3 9 64 18 

2 43 ao 29 0 

ik 13 0 63 25 


Total Means 6.9 9.8 Bien ‘la 
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test scores. In this way these figures provide information 
both as to the relative attractiveness of each of the alter- 
natives to the responding group as a whole and as to the 
type of student, in terms of test performance, selecting 
each alternative. 

Witiereference to Table XXVil and the nine following 
BAavlec se LeeCOulLdealso be nNouwed that Series 1" and iSeries 2" 
Perel mCOmtiie . Dre-plloGg =studies and that Series reters 
to an amended version of these original series, in which an 
attempt was made to improve faulty items. Each of the test 
administrations previous to the final one involved two 
classes, Or approximately 60 students. In the final test 
administration, as reported by these tables the N is 95 for 
PomrWeA ands96 LOr Form B. 

As is shown in Table XXVII, this item was presented 
epereaentical Lorm’ to four groups of students at three 
gifferent times. The ironical, self-mocking tone of the 
poem used for the item comes to a climax in the last line, 
pxou bet fF would!" In constructing the item the intent was 
EO provide distractors at odds with this tone in various 
Mayo is =. 1 think Lowould,” the fourth alternative, was 
Picended to project a neutral, or matter-of-fact tone, while 
mmwicie lt could.” ang ‘ON, 1: 1. Could” were antended to 
project an increasing amount of fervour incompatible with 
the tone of the poem as a whole. Thus a “tone continuum" 
for the item would have alternative 2, the correct answer 


(ironic) at one end, alternative 4 (matter-of-fact) next, 
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aiterpatavye le¢slightly texnwad)onext,, and alternatives 
(fervid) at the opposite end of the continuum. As shown in 
Table XXVII, there is a marked preference for alternatives 
2 and 3, those with more tone colour, over the more neutral 
alternatives) |) and 4 sin, four of the: five e:esponding.grnoups . 
Bicterpative 2, the original .(courect sanswer), was..chosen by 
roughly half the respondents, with the exception of the 
Grade xX group. The .item was considered satisfactory in 
Perio eOteltosi i Liclliywleve aA Lternabivesc., ssurthest on 
Enesabove tone continuum from ethe ioniginal,, was theuwsecond 
most popular choice (Grade X excepted) and alternatives 1 
and 4, the most neutral, were clearly the least popular. 
The overall test means of students selecting the 
various alternatives presented in Table XXVII confirm the 
Supposition that the number of persons selecting an alter- 
Dee Vvern1 Ss probably... though: not mecesisamily, melvated to the 
Rind Of persons making, the selection. . dn ,this-atem, 
alternative 3, the second most popular choice, appears. to 
have been chosen primarily by persons least skilled in 
PeSPONding..tOwa poem... 1% 1s.noteworthy that this alterna; 
tive 1S £urthest,on. the. “tone. continuum” frome the..correct 
amswec. ».cimilarly,. there 1s.a,stnong tendency fomealternas 
five 4, one of the least. popular responses, but closest to 
the Per eect answer. on the above continuum, to have been 
chosen by students with higher test scores than those 
selecting the other two distractors. In this way the item 


data correspond to the conceptual framework used in the 
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construction of the item and indicate the potential useful- 
ness of information to be provided by this kind of 
procedure in diagnostic and research situations. 

Anotherhkindtofsinformations provided by TablemxxVvIl 
is obtained by comparing the Grade X and Grade XII results 
Eoretheefinal testcadministration.! * Theses figures indicate 
a marked difference between the sensitivity of Grade XII 
students and Grade X students to the tone of a poem. The 
extent to which this difference is due to the study of 
poetry in school, as opposed to other influences such as 
maturation and general experience in verbal communication, 
appears to be a matter worth investigating. 

In summary, it appears that the item in question is 
reasonably successful in measuring what it set out to 
measure, and that scrutiny of detailed item data can 
provide information,» particularly relating tos "wrong" 
answers, which a summary examination of correct responses 
cannot provide. ©This detailed information promises to be 
mievaltucein Gaji@efinangthisskindrot .tem ar toe 
(b) diagnosing specific teaching and learning difficulties, 
Peery Contr butingston existing knowledge or mesponsemto 
Peetry by*high school students. For example, it seems clear 
that most members of the Grade ss oroupmrespondingetomthis 
item are unable to respond adequately to "tone" in this 
kind of poem, and perhaps in poems in general. More inves- 


tigation would be needed to confirm this. 
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Table XXVIII presents item data for Item 12, Form A. 
As with the previous item, this item was presented to four 
groups of students at three different times. The poem on 
Woleh it 1s basech@is: moresdueiiculethan the one just 
discussed and the considerations affecting its tone are more 
subtle. Nevertheless an attempt was made to construct 
distractors not of varying attractiveness but of varying 
discriminating power. Thus an attempt was made to make 
alternative 4 (in its first-person appeal) most similar in 
Bone to the oniginadl ftandytommaketalternativer2 Un its 
theatrical extravagance) least similar. 

The relative subtlety of what is being measured is 
reflected in the difficulty level figures. Only the Grade 
XII group, as a whole, seemed able to cope with the item at 
all adequately. Alternatives 1 and 4 were considerably 
more tattractive than alternative 3, the "correct" one, “for 
the Grade Xi group. Alternative 4, constructed as the 
second best choice, was selected more often than the two 
Other distractors by the Grade XII group. Alternative 2, 
constructed as the worst choice, was selected least often 
Pyeecell .qroups. 

Alternative 2 appecrea to attract the Teast able 
poetry readers, the "correct" answer (alternative 3) the 
Most able readers, and alternative 4 the second most able 
readers. These results suggest that the attempt to vary 


discriminating power of the distractors was generally 


| 22 ono" eis nats Divotiiib esoms 
~ geben 94% nod sii) paitootias nie: a . 

seem ah sna sone RE 1 
ud esanevisos sts enlyssy to.2 
Squetia os Burl, iewoq -t 


erpa-teebt cess mk) Bie 


pally tsv to 3 
adam of abam sew 

ab segimie saom (Leoqis Pp 

| edt ni) Sievktentetia exten of tes -feniero 
‘etal kmte' saset (coaBQsvstsne 

at: bexeR Rom wnkod ai Iaiiw %o yieigdue avitater, off 
vsesuptt Loval ysfvoltees ortt/ aby | 
5 benses’ ,sfode a gegqvemye 


‘beta ois yh 
on nes? okt KOIW Sqos oF of 


yitisvsbitnes eszow b one L aavigenrsgiA 
sansesiva nedd svios 


su% yan "atoomz0>” ott .£ Svs 
site Rbibetoustenos \) ovisscxsd LA ~qUOTREe™ 
qotd! AF wBdd 29% |For" bujosies asw yeobods seeds 


«Si pwastenaotiA ~quor1p TTX shed ‘att yd esrotosase: 


. Wedta sanel pedosies ecw .o>iors seam aoe ‘#9 bed 
) ,equote a 


“| f Ph. 


7 aa 1 


. sits gesel ad tost334 05 boussgqe' £ ovis . 
o wig (e @visanredis) xswans “Joex102" acid 
| “ida d20n bHoses ed bsvisenieils Brey ; 
ee grid tent s20pQue. Zaivess 


- yitssense few azodpsziaib ait 0 TeWwog.e 


TABLE XXVIII 


Detailed Item Data for Item A-12 


Burtaloseb ii isis 
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and break» onetwothreefourfive pigeons just like that 


he was a handsome man 


Jesus 


ana what 1 Want to know ies 


ee HOW Can agmaneso DULSting with life 


go live with Death 


Za) NOW Can Enis) wild spirat liveswith Deatn 
3. how do you like your blue eyed boy 


Mister, Death* 


4. what business do you have with such a man 
O Death 
Series 2 Dit Leudy 9 ald Biserial ~COm..06.0 0 
Selecting % Choosing Alternatives 
Grcup if 2 3 ix 
JMS es ali Se 18 14 cae 
5 23 08 oi. 38 
4 50 1s 0 38 
3 Dil 0 14 29 
Z 42 Ly, ed 25 
as 2 45 0 27 
Total Means Bene) i ISS o0 
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Poetry, ed. Louis Untermeyer (New York: 


BremWorid, 1962), p.° 473. 
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TABLE AXVLIL (Contanued) 


Pilot DitrrouLeye se PYscerva Carr ros 
Selecting % Choosing Alternatives 
Group 1 2 ee 4 
Total PAS 13 Ze 4 
5 29 alga 29 Pe) 
4 0 25 25 50 
3 18 18 27 36 
2 0 0 SS} 67 
ib ay 0 0 43 
Total Means 9.4 Cas 1,4 OO 
Pie (Otol Group Ottficurty .o. Piser tei ccri, moo 
Local 30 10 Sal 28 
5 3 0 60 2H 
4 25 07 43 25 
= 0 20 80 0 
2 35 Ae Ly 38 
sd 50 Lay 04 29 
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TABLEEXAVILE (Continued) 


Final - Grade X Di EGL Cust yi 6 Biserial Corr 239 
Selecting % Choosing Alternatives 
Group Z 3 4 
Total 43 14 16 pas | 
5 50 0 33 Any 
4 31 15 on 23 
3 42 1 08 30 
2 42 08 08 42 
- 67 33 0 0 
Total Means Bee AweG SWS) im 4 
Final - Grade XII Dit threultyen.46 Biseriad, Corr. 500 
Total sus) o%/ 48 30 
5 0 0 1S 25 
4 ics 0 62 26 
3 0 L3 63 25 
2 25 08 25 42 
il 40 20 0 40 
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successful. 

In comparing the Grade X with the Grade XII data it 
is’seen that-with'’the Grade XII group results, unlike the 
corresponding ‘results in ‘the previously discussed item, the 
dEpoernsOotmatiractivencss ontthetdistractoreslparallels sthe 
order of discriminatory power, while with the Grade X group 
ENereeappearaieco yoou! HEL lescormmespondence.. Vilhe (Grade exi1 
data for this item represent the type of results which 
Wwenpeshoped@fioritin *thesconstructionwvofl tthesPoetry Test titems. 

The Grade X data, on the other hand, indicate that 
although the item appears to have good discriminating power 
POIgorade eX students tiers sgencrally too dittiivculle for 
this level and, more important, that a sizeable difference 
may exist between the average Grade X student and the 
average Grade XII student in sensitivity to a poem's tone. 
This is consistent with the conclusion reached for the 
previous item, which alsc attempted to measure response to 


tone. 


(AleeeRnythm and Metrical Pattern 

Obethess2 items in)the Poetry Test, elghn cat cempced 
to measure students’ understanding of and sensitivity to 
poetic rhythm and to metrical patterns. It was originally, 
expected that high school students would generally find the 
tmetrical"™ items which comprise Subtest Four easier than other 
kinds of items, but this expectation was not borne out by 
the item data. Two of these metrical items, selected more 


or less at random, are examined in detail. 
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(a) "The Pulley" 

Table” xX xepresentcedetalled item data for Item 7, 
Form 8, based on George Herbert's poem "The Pulley". The 
intent of this item was to measure the ability to detect a 
fairly obvious metrical pattern. Since each stanza ends 
with a trimeter line, by deleting the final line of one 
Seeanze andeSupplyind asedisctractors lines with different 
numbers OfgitCet Or with feet which are irregular, it was 
hoped to measure students' awareness of metrical pattern. 
Thus, with other poetic elements kept as constant as possible, 
alternative 2 was made an irregular tetrameter line, alter- 
native 3 a regular tetrameter line, and alternative 4 a 
pentameter line. It was expected that selection of alter- 
native 3 would indicate a higher degree of awareness of 
metuacalLspattern than selection o£ alternatives 2 or 4. 

Table XXIX indicates that this was a relatively 
easy item for all groups, with, as would.be expected, Grade 
XII students finding it easier than Grade X students. 
Alternative 3 was the second choice for all groups, 
midveating that responsemto the item reflected the con= 
ceptual framework underlying its construction. An inter- 
esting point is that all#@gqroups showed a preference for the 
non-metrical tetrameter line over the metrical pentameter 
dene) indicating that line length had more to do with the 
selection than metrical flow. 

An examination of the test means suggests that, 


relatively speaking, the Grade XII students appear to be 
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TABLE XXIX 
Detailed Item Data for Item B-72 
(last 2 stanzas only) 


FOrei2 1 Should “(said He) 

Bestow this jewel also on my creature, 

He would adore my gifts instead of me, 

And rest in Nature, not the God of Nature: 
So both should losers be. 


Yet let him keep the rest; 

But keep them with repining restlessness; 
Let him be rich and weary, that at last, 
If goodness lead him not, yet weariness 


1. May toss him to my breast* 
2. May yet toss ham to my breast 
Bn May toss ham tinally tormy preast 
ay Mayetinallyetoss himeto my patient breast 
Series 2 Di ii Oda yan o Biserval,Corr..). 42 
Selecting % Choosing Alternatives 
Group 2 3 
Total 5A Es) We) LO 
5 HS 8 8 0 
4 43 P68) 14 14 
3s 50 10 40 0 
2 qf 2 0 18 
i 25 17 33 7 
Total Means Ono OU 8.4 grate 
nN enone ee 
lGeorge Herbert, "The Pulley/" in The English Works 


GieGeouge: Herbert, ed. G. HH. Palmer (BOs con: aehoOugh Lon 
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TABLE XXIX (Continued) 


Billo Dae ee a a7.) BiserialyCorr 6p 
Selecting % Choosing Alternatives 
Group 1* 2 3) 4 
Total 70 10 Lay S 
5 100 
4 100 
3 70 20 10 
2 33 0 30 33 
a 43 14 43 
Total Means 10.4 Bail AARO ole) 
ginal — Group Total Difficulty .60 BrsertealeCorr.w 44 
TotcaL 60 i ay. ui ah 
5 88 6 0 6 
4 86 0 14 0 
3 38 25 ike) 25 
2 52 1s} 29 
i 47 18 18 18 
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TABLE XXIX* (Continued) 


Final - Grade X 


Selecting 


Group t* 
rota. aan 
5 5 
4 E 
S 64 
2 iRS 
1 EG 
Total Means 6.4 
Final - Grade XII Ditirccw lay 
Total 70 
5 89 
4 92 
3 AS 
Z 43 
HL: ies) 
Total Means eh I 
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0 22 
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more influenced by metrical regularity while the Grade xX 
students appear to be more influenced by line length. This 
matter clearly requires further investigation. Where the 
PLriticulty Wlevel@is as high as 0.70, “as=it-a26! an some of 
these data, examining second and third choices is not very 
productive because of the likelihood that persons failing 
to select the correct answer are operating at the chance 
devel. However, it appears from these data that the item 
Toeceasonably "successful “ain'discriminating between students 
WiOmatesadDleeto aiscern tagiairily "obvious metrical pattern 


and those who are not. 


(b) "Tintern Abbey" 

Table XXX presents detailed data for Item 7, Form A, 
based on an excerpt from Wordsworth's famous poem. As 
distractors for the original standard pentameter line 
(alternative 2), alternative 3 is an iambic pentameter line 
with a feminine ending, alternative 1 is a hexameter line, 
pycdealternative 4 15 an irregular tetrameter line. It was 
expected that selection of alternative 1, even though not 
the correct answer, would indicate a higher level of dis- 
Eaimination than selection of alternative 3, and chat 
selection of alternative 4, the least metrical of the four, 
would indicate the lowest level of metrical discrimination. 

As indicated in Table XXX, these expectations are 
not borne out by item results, which are cContradicuoly. ana 


indicate no clear response patterns. Again, this is 


od't Be: netrer end eux “=, Lzaats 
a) ha ety , 
hy ac. ee ine a ys: 
ie : ae 
Maa ony a arta Botte Ane piso 
eit ee ‘soaking Boon ttedr ant = 
Jonnia mo 29 BteraeED 24= aioiene 29m" “ 
i] ead aah eens mo3 evikegan all tt 


SG7 L Wie 
in daswieel tduemtont ADS Ab kh “taxon 
poke) 4 axeseab oe 


,ao08 axa eufw ‘se 


aa ea a. 


mpage teen tom e(rehEanin 


“woddan npataae” ar} A. 
_ ; 
A weet” 5: mage =p, <b4Ql). lem! Fe se *XK elds: Ae ne 


ad va oa avs dip eoes ‘ta “pee Be ait a 


nA .#roece anes 
a to.kb 


ser Bepinnass 2 skgi so oft 2at cg 


wise 1a (ids oy 

svisemted ia, (& svisam ot + 
waistie ,paibas peat 
Lopnerat aa et? ovisentedhs . me 


ae 


‘one! seagrass (eer ah ies 
aif aa metect wiub aris 


ay 22  . SAR so *enetae 


son Hepaniaaem .¢ stevens ‘Ts bo gostpeise aad? ees si 
“210 34. Caveat Apatip ia 6.668910 &luvow . Towns 400 2. Bi 


gmat Oe c evddandtit'te to petsostes asada 
gawatt, afta Ber ine Eada speek 34, b onisenceinr Dg 
-bo-shoaleageanskeos 92 te Level, pemens oth 
mt ere eres viene ** 


160 


TABLE XXX 


Detailed Item Data for Ttem a-7 


And I have felt 
APpresence that advstureseme with the io, 
Of elevated thoughts; a sense sublime 
Of something far more deeply interfused, 
Whose dwelling is the 
Ana the round ocean= and the laving "arr 
And the blue sky and in the mind of man, 
A motion and a spirit that impels 
Pi Scianking sans pyeat op iectiss or all tiougiit, 
And srolvs, through all. things, 


1, E£ading ight of setting suns 
2. light of setting suns* 

3. fading Light.of “sunsets 

4. light of the sunset 


Series l Dative ty. 50 Biserual Corr mesos 
Selecting $ Choosing Alternatives 
Group il 2* S 4 
Total 10 50 2, 3 
5) 14 86 6 0 
4 50 0 50 
3 Le 50 33 
2 3 38 38 13 
ih 14 Sd. 58) 0 
Total Means Se peo eyes Fale 


SA 


1am. Wordsworth, "Lines Composed a Few Miles Above 
Tintern Abbey," in Poetic Experience, ed. B. C. Diltz 
(Toronto: McLeliand end Stewart, 1955), p. 278. 
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TABLE XXX (Continued) 


Pilot Disiauenu Liye. 65 Buserial Conn. .39 
Selecting % Choosing Alternatives 
Group pes 3 4 

Total 25 66 6 3 

5 14 86 0 0 

4 2D VS 0 0 

3 27 55 9 9 

2 0 100 0 0 

af 43 43 14 0 
Total Means Oye Lon on D0 
Pio w -aTlotal Group Ditticulty .33 Biserial Gorr. 4 
EOLaw 29 34 14 22 

5 33 60 0 7 

4 18 39 14 25 

5 40 60 0 0 

2 33 Pai 25 euak 

au 33 20 is 25) 


Total Means 59 ee ae 54 
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TABLE XXX (Continued) 


Final - Grade X Dee vom c yarns oO Brsenial Corre. 30 
Selecting % Choosing Alternatives 
Group 1 2* 3 4 = 

Total Ba: 29 16 22 

ie Ld 50 1a 1G 

4 23 = 23 aS 

3 S)3) 25 IBY 25 

2 A 25 0 25 

1 Sy} 7 ay]. 245) 
Total Means 4.8 Gow: Spee 4.8 


pina ~ Grade X11] Daw tacu loys. Ae BiseraedeCorm. ges 
Total 26 Al Hel 22 

5 25 wD 6 0 

& 38 38 0 23 

3 ee 63 0 25 

2 33 IE 3 Ay) 

1 0 20 0 60 


Total Means so 8.0 4.8 6.0 
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perhaps explained by the probability that persons unable to 
match a straight-forward iambic pentameter line, one of the 
standard English verse forms, with similar surrounding lines, 
are operating at a chance level. The item was fairly 
successful, however, in determining which students are able 


Popdetect a.reasonably straightforward metrical. pattern. 


Conventional end rhyme is probably the most commonly 
used and easily detected kind of sound repetition found in 
Pnglish poetry. it makes an important contribution to the 
musical effect as well as the structure of a poem, less 
essentially but more obviously than metre and rhythm. 
Because of this obviousness it was concluded tnat "full 
rhyme" items would fail to distinguish between the more 
and less able poetry readers and hence would be of limited 
usefulness for the present test. However, one such item 
(A-1) was included in order to test this assumption. 

Half-rhyme, or slant-rhyme, as opposed to. full 
Ghayme, is rarely used .and could be expected to be difficult 
tovdetect.. To test the degree of difficulty,,~twowltems 
measuring response to half-rhyme were included in the Poetry 
Mest... Thus the Poetry Tést includes,three items intended 
to measure response to rhyme. Two of these, one based on 
Dickinson's "Railway Train" and one based on Owen's "Arms 
and the Boy", dealt with half, or slant-rhyme. As might be 


expected, a detailed examination of item data for these two 
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items reveals a low level of awareness of half rhyme in the 
group as a whole, with much higher figures for the Grade XII 
group than for the Grade X group. Grade X students, it 
appears, have little or no awareness of half rhyme. The 
irregularity of the data patterns for these two items suggests 
that for the most part selection among the alternatives was 
not made on the basis of a knowledge of rhyme. 

Consequently, the third item dealing with rhyme, 
taken from a little known poem by Auden, was selected for 
detailed examination. The results of the item, which deals 


with full rhyme, are presented in Table XXXI. 


PPalg.OnesoOchn Sides” 

Table XXXI, which presents item data for Item 1, 
Form A, reveals that in constructing a full-rhyme item for 
such a test as the present one, it is almost impossible to 
avaia pLrogucing, one which®is overly easy. it may be noted, 
however, that with two of the five groups to whom the item 
was administered, more than 25 per cent of the respondents 
failed to detect the rhyme. Although it seems reasonable 
to assume that in an item as easy as this most students 
failing to detect the correct answer will be operating at 
the chance level, an examination of the data for the pilot 
study and the final test administration shows Via Voter 
first alternative, as a consistent second choice and 
"river", the second alternative, as a consistent last 


choice. This can perhaps be explained by the attractive 
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TABLE XXXI 


Detailed Item Data for Item a-12 


Puough he believe it; nopman pis strong, 
He thinks to be called the fortunate, 
To bring home a wife, to live long. 


But he is defeated; let the son 
Sell the farm lest the mountain fall; 
His mother and her mother won. 


His fields are used up where the moles visit, 


Tie, CONCOUrS WOrn silat: Le there show 
Passage for water he will miss it: 


Give up his breath, his woman, his team; 
No life touch, though later there be 
Big fruit, eagles above the 
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hy Paebh ke 
2 rrvers 
3. sea 
4. stream* 
Series 2 DLER Vel ty aco Bicerd dl iCorr aw S 
Selecting & Choosing Alternatives 
Group a 2 3 Ax 
Total 2 6 6 86 
5 0 0 8 92 
4 0 0 i3 88 
3 0 0 Q 100 
2 8 Li 0 ie 
if 0 9 2) 82 
Total Means feo GF 8.0 oO 
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1a. H. Auden, Chorus from "Paid on Both Sides," in 
Selected Poems (London: Faber and Faber, L933); 
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TABLE XXXI (Continued 


Series X DIttiCuuey a) 4 Biserial (Corr 8.49 
See ee ee ae ee oe ee Ee oo eee 
Selecting %$ Choosing Alternatives 
Group iW 2 3 4 
ieee es ee eee ST ee Se ee ee ee ey oe ae ee 
Total 2 iiggl kak 75 
5 0 0 0) 100 
4 0 ae 11 78 
3 0 50 0 25 
2 0 0 i igs’ 85 
1 13 25 25 38 
Total Means 6.0 L060 OO Oe 
Pilot Dic ieteyaee 7, Bigerva le Corr mass 
Total 0 3 88 
5 0 3 100 
4 25 0 0 he 
g) 0 0 91 
fu 0 0 100 
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Total Means Ss) Ae = 8.0 CMOS 
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TABLE XXXI (Continued) 


Final - Grade X DPEETSCWiGy e803 Biserial®Cortre 50 
Selecting % Choosing Alternatives 
Group 1 2 3 qk 
Total 20 2 4 Us 
5 0 0 Le 83 
4 8 0 0 92 
3 25 0 0 75 
2 a, 8 8 67 
1 67 0 0 33 
Total Means Bie0 4.0 670 “g2) 
Final — Grade XII pigs eke bNben, 6575768) Busey ade COTG sr .c0 
Total Le 0 2 80 
5 0 0 ¢) 100 
4 8 0 8 85 
3 25 0 0 15 
2 33 0 0 67 
1 20 0 0 80 
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flavour of "hills" and the fact that "river" is a two- 
syllable word. More significant, possibly, is a comparison 
of test means for respondents selecting alternatives 2 and 
3. These means are consistently high for "sea", the third 
alternative, and low for "river", the second alternative. 
Although both these alternatives were unpopular choices, 
"sea", unlike "river", was selected by the more able students. 
Pevpossiblewexplanation Lor theswcelection, 1s, that “sea” and 
Pstream,, tne correct answer, are rhymes of a sort. 

This item, then, was reasonably successful in its 
overall discriminating power and in its ability to separate 
respondents aware of ordinary rhyme from those who are not. 
The item also indicates little difference between the 
ability of Grade X and Grade XII students to detect a 


conventional rhyming pattern. 


(4) Metaphor 

(a) "Bereft" 

Tablerxxxl i oresents detailed item data Torn leven it, 
Form B, based on Frost's poem "Bereft". In this poem the 
Speaker, projecting his fear and feeling of desolation into 
his view of his natural surroundings which he describes in 
sinister terms, uses an extended metaphor in which a leaf- 
whirlwind is compared with a snake. By deleting one part 
of this metaphor and supplying distractors which falco 
complete it, an attempt was made to measure students' 


responsiveness to the metaphoric or figurative aspect of 
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TABLE XXXII 


Detailed Item Data for Item B-11> 


Where had I heard this wind before 
Change like this to a deeper roar? 
What would it take my standing there for, 
Holding open a restive door, 

Looking down hill@to a frothy shore? 
Summer was past and day was past, 
sombre clouds in the west were massed. 
Out an the porch’ s sagging floor, 
heaves got up ina and hissed, 
Blinding struck at my knee and missed. 
Something sinister in the tone 

Told me my secret must be known: 

Word I was in the house alone 

Somehow must have gotten abroad, 

Word I had no onejlert but \God. 
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TABLE XXXII (Continued) 


Series X lpg arenes bu ljens jee) Biserial Corr. .58 
Selecting & Choosing Alternatives 
Group Hi Ze 3 4 
Total 5 59 ) 2a 
5 0 100 0 0 
4 a. 56 0 33 
3 15 25 0 
2 39 15 38 
1 38 12 50 
Total Means TiO 1S ae) OF sig 3) 
PrLoOe Delisveabrelewliace 555) Buserial (Corr. m.o5 
Total 43 47 0 10 
5 14 86 0 
4 67 33 0 
3 40 30 0 30 
2 67 33 0 
14 Sul 43 0 
Total Means Seg 10.4 = Sas) 
Hinale- total Group Difficulty .36 BUSerdatCOGr .m.O) 
Total 40 36 4 20 
Ey 0 76 iby 2 
4 29 50 Ah 
s) ahah 38 Sih 
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TABLE XXXII (Continued) 


Final - Grade X Dati catiet yar G Biserialiicorus at6 
Selecting % Choosing Alternatives 
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poetic language. 

As the figures for the final test administration 
show, the item appears to be highly successful in this 
regard, particularly with the Grade XII group, although it 
proved*tor heson the ditiivculteside forthe Grade XX 
SCUCeENLS. "2 by” far the*moste popular distractor ain all test 
administrations proved to be "whirl". This distractor made 
its greatest appeal to the less able students, probably 
because of its association with "whirlwind" but perhaps 
because, metaphoric considerations aside, it is a better 
eigtceeciany Circle: wand “ringeeewhichmareevisueddy ess 
accurate, and “twist", which forms an annoying internal 
rhyme. It might be noted that "circle", which was sub- 
stituted for "whirl" in the second series as a less 
tempting distractor, proved to be far less appealing, 
probably for both metric and descriptive reasons. Alterna- 
tive 3, "circle", was consistently the least popular of the 
four, probably because of its visual inaccuracy, but 
BOsSsibly sor connotative reasons. "Twist", the fourth 
alternative, proved to be consistently more popular than 
Bfamgr and) circle", probably because of its greater visual 
accuracy and suitably sinister connotation. Generally only 
the less able students were attracted by NEwLst". | Apparently, 
the abler respondents were deterred by the inappropriate 
micernalernyming of "twist" and “hissed™. 

This item appeared to achieve its main objective of 


determining which students could complete the metaphor. In 
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addition it supplied some incidental information. As with 
the tone and metre items discussed above, the Grade XII 
group achieved almost twice as high a score on the item as 
was achieved by the Grade X group. The one possible weak- 
ness Ol agrhesitem is’ thatythe sthird jalternative, ring, was 
selected by so few students that it is barely operative as 
a@ecdistractoras, However, variationsim thesattractiveness of 
the distractors, unless too pronounced, was not considered 
aaseriOusplimitation efor athe .purposes tof ethespresent ~test. 
indeed ,»esuch Wvarnlability (jin ai tferentiating.between 
students with sufficient knowledge of the principle being 
MeasuredmatcOnse lect a splausiblesdistractor vand jstudents 
selecting more obviously inappropriate distractors, can 
supply more information than would be obtained by the use 


Shei LoreLecvors tot vnidorm abiractiveness. 


(jee rhougnt' , “or Plain Sense Meaning 

Bight ob the S21 temcsor Ene Poctry wlesctssOuGghumco 
measure the degree to which a student grasped some aspect of 
poee cthougit ,, Oraparaphrasaple Content, Of (a) poem.) These 
items varied considerably in the exact skill they were 
attempting to measure. Some, like the ones based on “In 
the Restaurant,” which tried to test a students skill ain 
making an inference from a dramatic situation, demanded a 
high degree of awareness of the whole poem. Others, like 
the item based on "Central Park Tourney", involved several 


contextual hints scattered throughout the poem. 
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(a) "In the Restaurant! 

Table XXXIII presents detailed item data for Item 
13, Form B, based on Hardy's “Im the Restaurant”. ~ In 
constructing this item, an attempt was made to ensure that 
a full awareness of the dramatic situation developed by 
the poem as a whole would be required in making the correct 
selection. An attempt was also made to construct one 
distractor, alternative 1, to attract respondents looking 
only, al thercontext: ofsthemlastmtworlines: one distractor, 
arcerimative 2, which contlicres wit thes context of the 
following line as well as the context of the rest of the 
poem; and one.;distractor,@allternative 3, which is patently 
self-contradictory. Thus, it was reasoned that alternative 
3 would tempt only the least wary and alternative 2 those 
respondents only slightly less observant, while alternative 
1 would act as the most effective distractor. 

An examination of Table XXXIII shows that the 
results, in terms of numbers of students selecting each 
alternative, reflect the intended strategy. Of the three 
desersecuOrs ls otay and Nice it ViopcoONals cemulys Chem leas 
popular. indeed, "stay and face it" proved) to be more 
popular—-than—the-original-for-two-of-the-foursgqroups-—te 
which the item was administered and served well in dlscrmimina— 
ting between students who understood the whole poem and those 
who did not. 

Tretia oie besnO Led ae lc teat Or, this item the Grade XII 


scores were more than twice as high as the Grade X scores, 
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TABLE AKI TTL 


Detailed’ Item Data for Item B-132 


BUGeleat. Li you stay, end theca ld bey born, 
iGwill pass asevour;husband's witheches rest, 
While, if we fly, the teeth of scorn 

Will be gleaming at us from east to west; 

And the child will come as a life despised; 

I feel. an elopement is ill-advised! 


ORVOULrGall Ze] nOltawhat 1 as my dean, 

To a woman! Daily and hourly alarms 

LeStecne scrutm snould out .geiow- can, lestay here 
And nightly take him into my arms! 

Come to the child no name or fame, 


Let us , and bear the shame. 
1.) Stay, andgrace 2c 
2. 290, and bide it 
On Stay ano locust 
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TABLE XXXIII (Continued) 


Pilot Di feveculey 2.4.3 Buser tal (Conia o4 
Selecting % Choosing Alternatives 
Group al; 2 3 4* 
fotas 33 20 3 43 
5 29 29 0 43 
4 0 0 0 100 
3 40 20 0 40 
2 0 33 0 67 
1 57 14 14 14 
Total Means O50 Ores 5.e0 10.4 
Pinole wrOtal Group, Dirpaculty...36 Biserial Corr. .54 
Fotal 38 1Ey 9 36 
5 12 6 LZ qi 
4 29 2a, 7 43 
3 44 Ls 13 31 
2 42 23 6 29 
if 59 18 iy 2 
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TABLE XXXIII (Continued) 


Final - Grade X Di Perc miy ere 4 Brserial, Coumm.67 
selecting % Choosing Alternatives 
Group iE 2 3 A 
Total 47 20 8 24 
5 38 1b) 3 38 
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indicating a dramatic increase in the ability to make the 
kind of inference demanded by this item with grade level. 
The required kind of inference seems to depend on sensi- 
tivity to human experience rather than on sensitivity to 


language per se. 


(ipjaek Central Park, Tourney." 

Table XXXIV presents item data for Form B, Item 3, 
taken from Mildred Weston's "Central Park Tourney", in which 
the visual resemblance of opposing car lights and jousting 
knights suggests continuing human competitiveness and rest- 
less opposition. The item itself, however, does not deal 
with the deeper meanings of the poem: it merely seeks to 
measure the student's ability to infer the identity of the 
first element of a metaphoric comparison from knowledge of 
the second element. This item was intended as an easy one, 
and the results presented in Table XXXIV show that it was 
Successhiiilean this respect. Of Lhe various e1stractors 
tried out during the successive administrations of the item, 
Mme and “boys” understandably attracted very few of the 
respondents. "Horses" proved unsuccessful as a distractor, 
eaetcacting only one Or two, or thejleastlablese udenis, 
undoubtedly because its selection would involve a nonsensi- 
cal comparison of horses with horses. "Steeds" also proved 
unattractive, although slightly more tempting than LnOGSeSh, 
possibly because, illogical as it appears as a ChOlcen wast 


better fits the metrical pattern of the passage and connotes 
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TABLE XXXIV 


DéetalledsitemwDatasror Ltem pao 
Pie Staged 
In the Park in Chem rark 
With long spear lights From dusk 
Ride at each other To dawn, 
Like armoured knights; The tourney goes on: 
Rush, Rush, 
Miss the mark, Miss the mark, 
Pierce the dark, Pierce the dark, 
Dash by: Dash by! 
Another two Another two 
ay dhe ac, 
Ll. Bikes 
eR COVS 
Sy Meehase: 
4. Steeds 
Series 1 Ditecultyeac0 Biserial Gorr.a=.o2 
Selecting % Choosing Alternatives 
TO cal 2 1S 80 Z 
5 0 ENS) 85 0 
4 0 13 88 0 
3 0 0 100 0 
2 0 22 78 0 
ih 0 18 64 5) 


Total Means be 0 6.6 aS) og @) 
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Mildred Weston, Bcentral spans Tourney," in Poetry, 
ed. K. P. Dover (Toronto: Holt Rinehart and Winston, 1964), 
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TABLE XXXIV (Continued) 


Series X De VC ea, BiSeridal COorrew. 6 
Selecting %@ Choosing Alternatives 
Group ut 2) 3% 4x 

Total 2 5 SM | SNe 

as 0 0 90 if) 

4 ith HL als 33 44 

3 0 0 25 OBS 

2 0 8 69 RG! 

ai 0 0 38 63 


Total Means bigs hat @) LOS ies TORS 


7 Changed for Series X only from "Steeds" to 
"shadows"). 


balou Disb Gi ine yar Biserial Corr.p.43 
Total She! 7 a) 

5 14 0 86 

4 0 0 G7 ae) 

5 50 10 40 

2 0 0 100 

i sy) 14 29 
Total Means 37.0 28) Oss) NAV 
Hind eo tOotal Group  Ditiiculty 267 Biser veils Corr mr 
Total 17 if 67 8 

5 ae 0 88 0 

4 0 14 86 0 

3 . 13 6 rhs) 6 

2 iis 10 68 10 

1 47 6 24 24 


Total Means he erga) 62.0 As 4.8 
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TABLE OXASLV a(Gontinned) 


10 


eZ 
18 


Final - Grade X Dut RiCuLC yao) BiserialseCorm: 
Selecting @ Choosing Alternatives 
Group uN 2 oe 
Total 20 8 Sh 
5 0 0 100 
4 ie: J33 74 
3 Bt a] 5 
2 1S) AS) 50 
it 45 0 37 
Total Means 4.6 re on 


Final - Grade XII Digtticultys.../4 

Total 3 6 
5 Aig 0 
4 8 8 
5 9 9 
2 0 
il 38 iN} 

Total Means Gis (Se 
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the agesof chivalry: 

It might be noted that "shadows", nonsensical as it 
is in the context of the poem from a denotative standpoint, 
received a surprisingly large number of votes, especially 
from the. less able respondents in the: second set of data. 
This outcome might be explained by the probability that 
"shadows" is an attractively nebulous word, highly evocative, 
whose connotations do not run counter to the prevailing tide 
of the poem and which students have been conditioned to 
regard as "poetic". 

"Bikes", which turned out to be the most consistently 
ger vacit vel distsactor, wasmconstructed fort this punposejmand 
appears conceptually to be the most likely alternative to 
"cars". It seems likely that the students successful on 
this item used clues such as "like armoured knights" and 
the uninterrupted sequence of the near-collisions to 
eliminate "bikes". 

Unlike the previous item this one proved about 
eouativaeditricult LomiGradel xe andy XTls students: (@rhis 
Suggests) thate this’ item! is operating) ast anconsiaderably tess 
sophisticated level of inference than "Restaurant", the one 


previously discussed. 


(6) Word Flavour 
Reewassnoted in Chapter 11, most currentscratical 
Opinion agrees that sound values in a word Or GrOup VOL words, 


even in the case of direct onomatapoeia, where word sounds 
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are meant to parallel rather than merely suggest actual 
sounds ("caw", "clip-clop", and "meow" are common examples) 
act not in isolation but in conjunction with the other 
Meanings, mainly connotative, which the word or expression 
may have. Thus in the present test it was found to be 
impossible to measure with any accuracy a student's response 
moesounc aloneveaclhé title fof ftohisisection fr “word hlavour 24 
reflects Chis inabrlity tandlis meant tto jsuggestsearmixture 

of sound and suggestion. 

InethesconstructionPar, the itenwitems twhichwcould: be 
described as intended primarily to measure "word flavour", 
two general tendencies became apparent. First, it was noted 
that even the slightest changes in the associational aspect 
of the distractors resulted in substantial changes in 
response patterns, and completely overshadowed changes in 
the sound qualities of the words involved. Thus, in Item 6, 
Form A, based on Milton's famous sonnet beginning "Avenge, 
O@locd  sthysslaughtered sarmnts;, Manvattempestosmeasune 
SEUcenitoumabdlicyeto Match the Varlous 2 LLernactves stOmtne 
SConcenuiniterns of Milton's rather distinccive “sounds. — 
his wrathful organ tones--was partially thwarted by the 
likelihood that selection among the alternatives was based 
more on their associational quality than on their sound. 
Thus) "fallen" was preferred to “murdered”, which im turn 
was preferred to "butchered", although on the basis of 
sound values alone "butchered" matches the context more 


closely and "fallen" less closely. This tendency is also 


i 


bhuicgess 2! ener dan oy: eoamoon yin daiw 
yyonRhy ona arti eta2 TO: otrry ent. pate uow DS 


pein @ Seas AF saae at tus yosicdetk ebdy atyeien | 


| . no oo breagpae bie bres: 

net) Biyies: th Baie ESE aed) et, to nelgosTaenes: edd oni Su 
‘shoal Dw" Maumee oo. y Loreerad pobta snd: en bodiaaeph 
<meta stayed astonshred 235m oie 
Jia wh eoteods teahip tes ats nee - 
nd) senso Lebar pcae i howl ot eros sdBL5 = 


slestebqetioo hire euros senoqeat 


sinew mts to getakiaope bac 


‘peiaw pee ti. Seto 


“eg Las ee aalan 


at woamide Revohatraavo 


ue Weetwh Aha a ees 


sah uus” yeipReee auehoe syomnt 2’ antl 2a ae need 
Sea ST) Deis 1A. hey 22 3088 pore-nipuete yas biped 
(3s doom og ets? 


aie ot aitidegmetlh cues 1 
oth 2g) GOEL ee cremate ' and Li8 lo Boxee hh 
wit vu hastens vi Sarre 2 “henge aeead ividgese” 
; are Ts 

iaéiind aun Cowes aesgis. af? prom wuddoekes sed “Door 
fran” that, ne qoah (tite. Lert Lse.ocean tiods ne 
far? 24 epeite ge US emmeeR’ ou bershsarg now Snatiek® 

, fo BOW ree 

1° ah il ag? id Rineiaale ."hotedhaud" as% 1183465 


184 


noted in the two items examined below, one based on an 
excerpt from Julius Caesar and the other on the deservedly 
famous poem "Study Hall". 

AY second Cendency noted "in the construction of 
"word favour" items is that the more the item measures the 
sound quality, as opposed to the suggestiveness of a word, 
the more the Grade X results resemble the Grade XII results 
PmeceriseOr Citticuity level. This tendency suggests sthet 
amsensitivity to the™sounds=of words tends to level off 
GCariversthan most of the other skills which the test 
eattempts CO Measure. “Sensitivity to the sounds of words 
may be a more basic and unconscious phenomenon than sensi- 
tivity to the other kinds of meanings, both denotative and 
connotative, which are more dependent on consciously 
acquired experience. It may” “be more a matter of tempera-= 
mental differences than of formal learning. If this con- 
clusion is warranted--and this matter clearly bears further 


investigation--it should be noted by the teacher of poetry. 


(a) “from Julius Caesar 

Table xXxKV presemes: ttem data tor [tem 6, sy ormen: 
fetches conccruction, of the dastractors for this item, every 
effort was made to keep constant all aspects of poetic 
meaning except sound. There was no problem in producing 
alternatives satisfactorally equivalent denotatively and 
metrically. The real challenge was to control ehepconnota=] 


tive element. It was felt that this control was finally 
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TABLE XXXV 


Detailed Item Data for Item B-62 


O, pardon me, thou bleeding piece of earth, 
That I am meek and gentle with these butchers! 
Thou art the ruins of the noblest man 

That ever lived in’ thegtide of the times, 

Woe to the hand thatechedsthre<-costiy bilocd7 
Over thy wounds now do I prophesy 

(Which, like dumb mouths do ope their ruby lips 
To beg the volcevand utterance of my tongue), 
Aecurse shall iioeheeupon the, limos of men; 
Domestic fury and 

phall-:cumber ally ghevpapts oreitaly: 

Blood and destruction shall be so in use 

And dreadful objects so familiar 

That mothers shall but smile when they behold 
Their infants quartered with the hands of war, 
All pity choked with custom of fell deeds. 


1. fierce civil war 

Dea Wists Cay igor ete 

3 fierce violence 

4 fierce Civil strife* 


Series 2 Difbiculty 39 Buserial corr nr. dc 
Selecting % Choosing Alternatives 
Groups i} 2 3 4* 
Towa L aah oe i 41 
> 0 PS) 8 67 
4 43 14 14 29 
3 20 50 0 30 
2 ou 9 18 46 
1 2D 25 28 i 
Total Means Cres ome Shia DO hes 
Re ee I IEE ET TE TE 
af 


Wm. Shakespeare, Julius Caesar (AG tal gh yo Conese) i 
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TABLE XXXV (Continued) 


Bilot Di ie Cute, Aap Bisertal Gorn. 9.36 


Selecting % Choosing Alternatives 
Group te 2 3 4* 
Total 20 one) 3 47 
5 14 14 viz 
4 0 0 0 100 
S 40 30 10 20 
2 0 67 33 
1 14 43 0 43 
Total Means ets sya ti) HOC 10.4 
Einal — Total Group— Difficulty .49 Bisertaly Gonn.o. 26 
ota L a3 29 9 49 
5 2 12 2 64 
4 24: 21 14 44 
3 i 25 12 50 
2 10 32 3 55 
a 6 53 12 29 


Total Means fle od 56 Wed hee 


i 


1 a y >on 
‘eee can Tg ae mor vttust eke ry - 


& Ga eos 
A — ae 1 7 
o— 


37 


TABLE XXXV (Continued) 


Final - Grade X DIfi2cuLeyes45 BWSen rales or meme te 
Selecting %@ Choosing Alternatives 
Group al e) 3 4% 
Total 16 33 6 45 
> 25 i LZ 50 
4 25 13 12 50 
3 14 43 i] 36 
2 ise 38 0 50 
il ) 45 0 45 
Total Means G0 4.8 ee 0 Grew) 
Final - Grade XII Di EvCuley woo BiserieVeCOmi aaa. 
Total 6 26 ike ays) 
5 0 iNaE ala 78 
4 Li 17 rf 50 
5 9 36 45 
2 14 86 
1 50 25) 25 


Total Means 9.0 5) 418) US 8.8 
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successfully achieved: the emotional colouring of, say, 
ericrecrviotence™ sand wildecivulWstrite appeared tro be 
very nearly the same and to match the context of the excerpt 
aswell as of the original ‘phrase "fierce civil strife". 

The only variable appeared to be the sound, in which the 
four alternatives, by means of various arrangements of 
consonant clusters, ranged from the extreme cacophony and 
GxpLos#Veness OfPthetoriginal ,VUfiercel:civilystrize”; 
EhEOUGh*A=widd Civil Strife sande" fiercés%civil wartpto the 
relatively mellifluous "fierce violence". 

An examination of Table XXXV shows that the item was 
generally successful in separating students more sensitive 
to the sound qualities of a group of words from those less 
sensitive to sound qualities. Also, that alternative 3, 
considered the poorest match, proved to be consistently the 
least attractive choice indicated that the item was 
successful in modulating the degree of appeal of the three 
distractors, and hence, presumably, in identifying the 
respondents least sensitive to word sounds. | 

A glance at the biserial correlation coefficients 
and the test means of the students responding to the various 
alternatives, however, indicates either that the item has 
Eewiltyerdiscrammating abulity or that at measures agekist 
very different from the composite skill measured by the test 
Aowa wiole.. That the test means for the distractor con- 
structed as the poorest choice are, if anything, higher 


than those of the cther distractors gives some credence to 
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to the first of these explanations, that the item in general 
1s deficient in’ discriminatory power. ! In view of the diffi- 
culties in measuring sound values as separate from connota- 
tion, andwin viewPorsthe subtle Aiisree nee between the four 
alternatives on the sound dimension, this lack of discrimina- 
ting ability is perhaps not unexpected. 

Ptimighnt ybéesohWnterest, finally, to compare the 
item data for the Grade X and Grade XII groups. The overall 
gibriculty leveiM@rswquite Similar fon the two croups, but 
while 1t is quite®clearSthat for the Grade XII group the 
"correct" answer attracted the abler students in terms of 
BOLaeLest, perrormance, £01 Grade X there is virtually no 
correspondence between success on this item and success on 
the test as a whole. Perhaps this serves to confirm an 
earlier remark about responsiveness to word sounds as a 
largely unconscious phenomenon not necessarily related to 
other kinds of word meanings. This matter appears to 
warrant further investigation, and is of considerable import 
MOteOIye LOL Lesponse (to poetic language but Tor (response 


to imaginative language as a whole. 
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Table XXXVI presents item data for Item 16, Form B. 
This item was selected for detailed examination largely 
because having been presented in four different forms to 
six different groups of students it promises, perhaps 


better than any of the items discussed previously, to 


ae nat a ae 


atte “i Soa ong jeosedemtb hindi yal. iis ie 
| Madoeqeone sow agers * 


San tousaemh, to ade 
30 1x, ahasy tote ih pres ony’ core _ 
peti ye Aap setic $e aa eup at Laver x J 


itd sages cs 


i 
- 


in t2¥0 att en 


T Wwe 


tiv ‘atasmly tot sande eed atixp ae ahke 


Feo is atta? As 


oft | gers 


35 ena wie asause satan of Beduestise: sawens, " 


‘4 ww cal 9 AOS AO, $009.3 


ak Gli SRS tH Ae yet? ¥. 


‘s ZROUE 3 f i eP7 Se 42 @2eooue neawind, soaeon 1x¢ 
i £aoDoe bus 992 AEE Ps a ih 
Ga ont tage oe aves etfs eyenuat alone & 2S ~ a. 

, an. ¢ pinta wry OS woay shade ee sade tusmes: a 
ee bodetias Yet see top sionemoaadg evo kwenontus Lag 

a qtangge FS ene!. .ape coum bxow, Lo abaia 


a@ungal efadgess nna. ty ef fom ,pehsepiseeons serttset 2 


' 80492 sat J anette Siz SeG oe)» senogZet 4022 
2. bieiy 4 oF “a ee hoar tee 


- 7 


. 


; ‘tea, bu | 4a - 


- . : ye ery en 
8 may , a weet Sot atk, fad: et iva ‘sldet 
ee 2 i 


Oy Ty S 
as . 


giogiet me Lies “tread be vab y0¢ bevanten: 2: 


4 at anrset . sd iY aug? HS poinpeotg ated § vad 9 a 
bs _ ee aoe 


ae © Si atenk as: ree Dee wore” es 2 
3h ee: ema — Bil 


£30 


TABLE XXXVI 


DetailediltensData for Ttem B-162 


Smuggled sibilants, 

Rattling pages, 

A muted yawn, 

someone ages away, 
Faint footsteps overhead, 

A clicked looseleaf, 

Desultory drumming of bored pencils; 
A faintly sweaty, chalky smell; 

A weary, yet taut, expectation 

Of the noon bell. 


Loren ing. 
2. whispering 
3. Laughing 
4. muttering 


Series 1 Davia GUase Ou Biseri aieCO vias 52 
Selecting % Choosing Alternatives 
Group 1* 2 a7 Ae 

Total 67 PG | 3 3 

5 86 14 0 

4 100 0 0 

mS 67 23 0 

2 50 25 ae ihe 

i 5 43 0 0 
Total Means 13 60 6.0 6:0 
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“Changed for Series 1 only from “laughing” “and 
Pruttrering. to ‘talking” and “speaking”. 


lyavier Warden, "Study Hall." Unpublished poem, 1958. 
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TABLE XXXVI (Continued) 


Series 2 Dies Geiwisiey 58 BUsSeuual, Comin ao) 
Selecting % Choosing Alternatives 
Group IE bee oe) Se oe eo ce eer deg 

Total 58 4] 2 4 

a ad 23 0 0 

4 q's ie 0 13 

3 43 bad 0 0 

2 42 42 8 8 

di 27 aps 0 0 
Total Means Oe h te Oro Bee O 


#¥ Changed for Series 2 only from "laughing" and 
BiieweringiaeOw jabbeimnal land a babbling’. 


Series X Date CcoWwe ar. .0 Biserial Corr. 20 
eo toed 36 PLS, 32 7 

5 40 30 20 10 

4 44 44 i 20 

3 50 0 25 25 

2 S)il 15 54 10 

AE 25 25 38 12 
Total Means 12.4 bien) On Ue og 
Payot eet Tete rr Or Beseriadl—-Corre 76h 
Total 63 ae i 

3, 86 0 3 ey 

4 | 67 19 14 0 

3 80 0 20 

2 33 25) 0 34 

1 ee, 43 0 28 
Total Means AMOR) ome 2s 0 The 
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TABLE XXXVI (Continued) 


Hine bee O Cade Groupws Datr) Cit yao Bisevial, Corry. 47 
Selecting = Choosing Alternatives 
Group 1% 2 3 4 
Vocal 39 34 q| 16 
5 ipl 18 0 6 
4 50 36 7 i 
3 50 25 0 25 
2 16 45 1233 L3 
1 29 5 ip 24 
Total Means On2 Ore Bret, 553) 
Final - Grade X DLEEL CULE YS +39 Bisepral*Corre = s42 
Total 34] 33 6 18 
5 75 £3 2 
4 62 18) 25 
3 14 50 14 Ia) 
2 Tees 50 13 14 
i 36 24 24 
Total Means 61 aS Shige! BY 57 
Final - Grade XII Dit PLeuitiye. 43 Biserval’ Corr. .o5 
hota 43 34 S) iS 
5 78 ia 0 Tae 
4 50 33 0 uy 
3 36 46 0 18 
2 29 ws) 42 0 
i 1s 50 ike 14 
Total Means ets) teal oo 8.0 
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révea = Ciewellects Of changeswine tem LOrmeon test results. 

In its final form, as administered during the pilot 
study and in the final administration, the item was gener- 
ally successful and attained suitable difficulty levels and 
Yerativery Might biserialecomrelation coer ficients. | As an 
most of the items in which word sound played a prominent 
Parc, ce? Grademrx "and Grade Xil ditficulty Wevels were 
similar. The probable reason for this has been discussed. 

In the initial construction and subsequent revisions 
of the item an attempt was made to provide distractors which 
Suited the context equally as well as the original version 
on the denotative and metrical dimensions, but which varied 
iretnerw, SUleaotiNty EO the contem: according tossuqgestive 
and sound qualities. Thus it was felt that while all of the 
distractors make equal sense in terms of the context of the 
woo ke=poem, Groping”, “the "original, an its connotationvand 
sound best suits the atmosphere of boredom the poem seeks to 
convey. 

From the item data based on the initial form of the 
item, it appeared that the item had promise--that 
"whispering", the second alternative, was a successful 
distractor in terms of attractiveness and discriminating 
power, but that the overall value of the item was weakened 
by the fahx of attractiveness and hence of effectiveness of 
the third and fourth alternatives, “talking" and "speaking". 
Consequently these were changed, again without sufficient 


attention to potential attractiveness, to "jJabbering" and 
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"babbling". As might be expected these were both rejected 
by the vast majority of the respondents. It might be noted 
that "talking" and "speaking" were probably rejected because 
of a lack of evocative and sound colour, while "jabbering" 
and "babbling", although highly coloured words, were 
probably rejected because their association and tonal 
colouring is too obviously at odds with the rest of the 
poem. “sourcing and “laughing ", an the second and third 
revisions, seem to be in much the same position as "talking" 
and "speaking", i.e., they are too neutral connotatively. 
These distractors do, however, appear to possess more 
GConnotative antensity than “speaking” and “talking”, 
although to some extent their overtones, like those of 
myabbering sand “babbling ™,. run stoo obviously counter sto) the 
prevailing mood of the poem. Again here is a rather subtle 
matter which requires systematic and detailed investigation. 

It could be argued that "muttering", in terms of 
the atmosphere of the whole poem, is the second best choice, 
sbightplyemarcesudcable “than “whispering”. It, turned gout to 
be a reasonably attractiveaedistractonuandginathe Ennal 
administration of the item tended to attract slightly more 
eblewstudents than» did,twhispering,»). 

Thus after many changes the item turned out to be 
Brecesasul not, ,only.in.terms,o£ difficulty slevelsand joverall 
discriminating ability but in producing a response which 
reflected reasonably accurately the conceptual framework 


upon which it was constructed. In addi tone tO dentin yang 
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both the most able and least able students in terms of total 
test performance the item provides information upon which 
inferences regarding the selection of one kind of word or 
another could be based. From these inferences it is hoped 
that sharper, more effective items of this general nature 


Cans be cons teucted, 


cummary Of the discussion of individual items. The 
foregoing relatively detailed examination of certain items 
Waseintended chiefly to indicate the kinds of information 
regarding student response to poetic language which a test 
of this kind can provide. Because of the largely explora- 
tory nature of the study, the experimental test forms were 
intended more to give direction to further, more rigorously 
controlled investigation than to provide conclusive 
information. Nevertheless certain generalizations emerging 
from the previous discussion can be presented in summary 


LOEM ? 


(1) General Comments 

aeweineatyoe Of testing procedures useduin une 
present study appears to be effective in measuring a wide 
variety of the component skills involved in deriving 
meaning from a poem. These skills include awareness of tone, 
metrical ey various types of rhyme, the operations of 
figurative language, the effect of word sounds, and the 


implied dramatic situation in a poem. 
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b. The present testing procedure also appears to 
make possible the construction of items which measure these 
various skills at different levels of sophistication by 
including distractors either grossly or subtly inappropriate 
Loe chescontext. 

c. Apparently minor changes in the alternatives 
provided for an item often produced fundamental changes in 
response patterns. This confirms the view widely held by 
bVterany critics that the relationship, or balance, between 
aewOrGeOLeexpression in ’a poem andeits, context as an 
extremely delicate one, and makes the construction and 
refinement of items such as those used in the present test 
an, exacting task. 

d. An item administered unchanged to different 
BcrOupsecam=procuce widely diiiering Lesponse ~patcerns waren 
are not necessarily due to grade level. This mercurial 
quality of response for some items is potentially a serious 
weakness of the present kind of testing and must be remedied 
ineOordersto Obtain a Satistactorily relrablewand eal 
measuring device. 

e. As could be expected, the number of students 
selecting a given alternative is not necessarily related to 
the kind of student making the selection. Clearly, both 
kinds of data need to be carefully examined in assessing 
and interpreting an item. Certain items apparently too 
easy or too difficult in terms of the 0.50 QUVELITCULTY 


level criterion endorsed by most testing authorities are 
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eonstdered@useful’ fom ther present testing procedure if they 
possess adequate discriminating power. These items can be 
effective in isolating students deficient in "easy" skills 


and ‘those: showing masteryeorst'daftacuit" ‘skiliis. 


(2) Comments Regarding Specific Skills 

a. Grade X students were generally unable to respond 
adequately to the "tone" items. 

b. In response to the metrical items, line length 
appeared to be more important than smoothness of metrical 
flow- 

Coan CONntrary GO expectation, the metre: (chytehm) 
items were generally no easier than the other kinds of 
items. This matter will be elaborated upon in Chapter V 
in the discussion of the interview results. 

d. Full rhyme, generally, was easily detected. 
Even so, approximately one quarter of the students in the 
total sample were unaware of the rhyme in the one "conven- 
tional rhyme" item. 

en Halt rhyme, Oras banter hye, Measured: latwore ks 
the o2 stems, was detected) by less thanva quarter of the 
respondents. 

£2... In responding to items dealing with connorative 
meaning or relatively subtle denotative meaning the less 
able students appeared to be influenced more by the quality 
of the alternative itself (its "poetic" appeal, its internal 


consistency, its "stock" association) than by its 
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appropriateness ormitsmcontext .MicCasestin point “are "whirl" 
(page 172), "shadows" (page 182), and "stay and face it" 
(page 174). 

g. Grade level appeared to be a highly important 
factor LIimeesponsestositemsimnvolyingsaniagplaed rather 
than Cpentivipmtcated;) plotiorls dramatic sa tuation. 

h. In attempting to measure sensitivity to the 
sound value of a word or expression, it was found almost 
impossible to vary the "sound" without varying the sugges- 
tive quality even more (page 183). This supports the 
generally held critical view that word sounds in poetry 
operate only in conjunction with other kinds of meaning. 

It also makes the construction of purely "Sound" items for 
acest OLmbhisenattre highly ditiiculLlt. 

i. For the item which-appeared most successful in 
Measuningas Sound! )asidistinctetromisuggestion, (B-G6), there 
is little difficulty-level difference between Grade X and 
Grad esiiiestudentser Thisindicates aricertain Wevelding oli 
Oemsensitci Vitye bore the purely: sound! aspect offs poetic 
meaning after Grade X (page 184). 

InsGhapter Vise some of ther implicatwons for further 


research suggested by the above findings will be discussed. 
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PERFORMANCE ON THE POETRY TEST 
BY VARIOUS GROUPS 
Grade Level Differences 

Hypothesis 1 on page 13 states: 

There is no significant difference between the mean 

performance of Grade X students and the mean per- 

formance of Grade XII students on the Poetry Test. 

This hypothesis was tested by means of two-way 
analyses of variance! for (a) Grade Level by Test Form, 

(b) Grade Level by Sex, and (c) Grade Level by Reading Test 
performance. Grade Level effects were used as a common 
element” in’ these analyses “in order to facilitate comparison 
of the relationships between Grade Level, Sex, and Reading 
fevel”and Poetry Test performance, 

Because of the nature of the data a procedure 
assuming a fixed effects model and allowing for unequal 
numbers of observations per cell was selected. 

The complete analysis-of-variance data for each of 
the subtests appear in Appendix F. The four tables 
presented here deal only with total Poetry Test scores. 
Tape XXxVil presents the, results for the analysisvor 
variance for Test Form by Grade Level. Grade Level Main 
Pecectcuaressi cnt icant at the 0.001 levelfom conmdcnce, 
Wile Tests"orm Main Eifects are, not significant atetne 0.05 
eVeus. ie ea igsano-Ssigniticgant’ anteractionsbetweenmehestwo 


factors. However, Table XXXVII also shows a serious lack of 


homogeneity of the popularion error variances in this analysis. 


Lee A. Ferguson, Statistical Analysis (New York: 
McGraw-Hill, 1966), pp. 300-323. 
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Because homogeneity of variance is one of the assumptions 
under I wing atic statistic athics lackiolaces, the Accumacy ao 
the decision reached by the F test in question, and dictates 
that these data be interpreted with caution. Nevertheless, 
Winer* observes that moderate departures from homogeneity of 
variance do not seriously affect the accuracy of these deci- 
sions. Kirk? furcnersnotes that such wWdepantines, areynot toe 
Serious af the number of subjects in each cell is the same. 
Since, these cells are. very nearly equal in the present 
analysis and the Grade Level effects are highly significant 
(p¥= 0-001), these data appeay to support the conclusions, 
Duets TenoOnted , that sche, worms «ane MOt pardlies sangaciat 


the Grade X students responded at close to the chance level. 


TABLE XXXVII 


Two-Way Analysis of Variance on the Poetry Test 
Ha Cils@iGuelws Test Form 
Factor B. Grade Level 


SouncejotmVariation ss DF MS F p 

ca Mazin Bifeccs Liacyz2) 1h Nera S243 Od 
"BY Main Bifects 195.4 i 193.4 Syehoms gl 2 cl OO)u 
"AB" Interaction S)i2) ik Brea 4) oo 
Boron Tern Oe! 186 Suey. 

Homogeneity of Variance Test Chi square = 14.50 p = <.001 
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oe JeeWiner, Statuctweal Principles sie experi mene! 
Design (New York: McGraw-Hill, 1962), p. 33. 


Roger Kirk, Experimental Design in the Behavioral 
Sciences (Belmont, Cal.: Brooks and Cole, 1968), ppw ol-62. 
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Table XXXVIII presents results for the two-way 
analysis of variance for Sex and Grade Level. For both 
Forms, A and B, Grade Level Main Effects are significant at 
the .01 level. Sex differences in performance are not 
Statistically significant and there is no significant 
interaction. 

Table XXXIX presents results for the two-way 
analysis of variance of the Poetry Test criterion scores 
for Grade Level and Reading Level, as determined by Reading 
Test Tocals. For Form A, Grade Level Main Effects are 
Significant at the .01 level, while Reading Level Main 
Errects do not attain statistical significance, and there 
is no Significant degree of interaction. For Form B, Grade 
Level Main Effects are significant at the .001 level, 
Reading Level Main Effects at the .05 level, and there is 
no Significant degree of interaction. 

The results presented in these three tables indicate 
that Grade Level is more significant than Reading Level and 
Test Form, and substantially more Significant than Sex, in 
Centaibuting@lo variance in the Poetryelest toval scores. 
Null hypothesis 1, therefore, is rejected. 

It appears reasonable that this substantial Grade- 
Level influence is due to such factors as maturation, 
practice in communication Ska blew thieescugys.oG el bteracune 
in general, and the study of poetry im pakuLrculan. mnOwevec, 
determining the relative importance of such factors is not 


within the scope of the present study. 
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TABLE XXXVIII 


Two-Way Analysis of Variance 
PaACtoOraA . Bisex 
Factor B. Grade Level 


Source of Variation Ss DF MS F p 
FORM A 

PAweNatt bt Sects LenS ne lees 529 359 
"B" Main Effects Fee, 18) a 6280 13 25) 4 <2 008 
PARTS Interaction 30 1 B20 -65 P42 
Error Term a OLA) 89 Ave 

Homogeneity of Variance Test Chi. square = 3752 p =23382 
FORM B 

"A" Main Effects ore as B64 aoe e225 
Ppa Maine sr Lects Ay, i TA eis SARS Op? <-,001 
PAB” Interact Lon ed, 1 Sd .88 $35 
Error Term OH, 92 6.4 
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TABLE XXXIX 


Two-Way Analysis of Variance 
Factor A. Reading Level 
Factor B. Grade Level 


Source of Variation SS DF MS ig) p 
FORM A 

"A" Main Effects PIER TA Z Lay) Zon . s07 
"Bw Main Bfiftects (sya (8) i 65.80 147.58 Sete OME 
ae bined c ton 2D. 0 2 UN Gira €) eerie Fatal 
EGron Term 3.19.28 74 

Homogeneity of Variance Test Chi square = .48 p= .44 
FORM B 

KA va Main EGeects 48.6 2 Byles 3 Ara. 202 
poe Matai ects OB. 2 a 93 a42 LS yopeze rey OLOE 
TAB el iceLaCctiLon LO eh 2 9.8 1.64 5 Ako) 
‘Severna Sabena! HN FSS Pa 19 6.40 

Homogeneity of Variance Test Cha *"squere-— 210 or. Od 
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As a further means of testing Hypothesis 1, means 
and standard deviations, grouped by grade level, are pre- 
sented in Table Xi. It might) be noted that, overall, there 
is a mean increase of approximately 37 per cent in Poetry 
lest totals Of Grade XII scoresyover Grade X scores, while 
in Reading Test totals there is a mean increase of approxi- 
Mately w30yper cent. Looking at. the subtest: means, it 
appears that overall mean increases for Subtests One 
(Thought) and Three (Sound) are also approximately 30 per 
cent, paralleling the Reading Test increases. Mean increases 
for Subtests Two (Suggestion) and Four (Rhythm), of approxi- 
mately 50 and 45 per cent respectively, are considerably 
higher. A likely explanation for this is that Subtests One 
and Three measure skills which, like those measured by the 
Reading Test, tend to fall in the category of "general 
language’ ability), or “general ability in communication ~ 
Subtests Two and Four, on the other hand, may measure skills 
more idiosyncratic to poetry, perhaps more subject to rapid 
pncreases ast auiresult cn specialized instruction .mwii wis 
Px pianuattones avalia, the limplication <orm thewtecachersor 
Pnglich 1s) that, although some of the components, Of gskilil 
in responding to a poem develop more or less naturally, 
others must be intensively and artificially cultivated. 
Hence, Both extensive and intensive approaches to the 
teaching of poetry appear necessary, with each complementing 


the other. 
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Sex Differences 
Hypothesis 2 on page 13 states: 


There is no significant difference between the mean 
Performance of boys ancigirlsson the Poetry Test, 


Table XXXVIII (page 202) shows that Sex Main Effects 
make no significant contribution over and above grade level 
LOnEnNe= total variance of thescotal scores on the Poetry. 
Test. Null hypothesis 2 is therefore not rejected. As was 
anticipated, boys and girls at the high school level appear 


to have approximately equal skill in responding to poetic 


language. 


Reading Level Differences 

Hypothesis 3 on page 13 states: 

There is no significant difference between the mean 

performance of high Reading Test scorers and low 

Reading Test scorers on the Poetry Test. 

In order to test this hypothesis, Grade X students 
and Grade XII students were assigned to top, middle, and low 
groups of approximately equal numbers according to Reading 
Test wtobale scores). Table XXXIX (page 203) presents the 
results of the two-way analysis of variance on Factor A, 
Reading suevedys and) ractor B,sGrade Level’, ror Poetry Test 
SeOLesmOne DOU weSterorns:. 

Thais sabablewshows that for Poetry Test totals =the 
differences in responses due to differences in Grade Level 
arcemnion is samo tcantm (pe <.0).001)- 8 "Ditterences jan Coral 


Poetry Test response due to Reading Level do not attain 


Significance at the 0.05 level for Form A but are 
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Significant at the .02 level for Form B. Null hypothesis 3, 
Pepchererore ejected (forgrorm es bub mot rejectedfor Form A. 

the results indicate that;vineline with expectations, 
there is a much closer relation between reading ability, as 
measured by the Reading Test, and the ability to respond to 
poetic language, as measured by the Poetry Test, than 
between sex and the ability to respond to poetic language. 

Contrary ttorexpectations = butrreflecting tthe 
relatively low intercorrelations between Reading and Poetry 
rest totais reported earlier, grade level bears a far closer 
relation to Poetry Test total scores than do Reading Test 
scores. Several possible inferences can be made from the 
results presented in Table XXXIX. One is that general 
reading skill, as measured by a typical standardized reading 
test, while bearing some relationship to the more specialized 
skill involved in responding to poetic language, is suffi- 
ciently different from poetry reading skill to warrant a 
specialized teaching approach to poetic language. It does 
not appear reasonable, on the basis of the interpretation of 
the data relating to the present investigation, to assume 
that a student with good general reading ability can deal 
ettectbively with poetic Language. ‘On vthe contrary at would 
appear that students need to be taught in a systematic 
manner how to read poetry. 

A second inference which can be made on the basis of 
the above data is that the Poetry Test is somewhat 


unreliable. There is considerable evidence within the 
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present study, relating primarily to the lack of statistical 
equivalence of the Test Forms, to suggest some lack of 
reliability in the Poetry Test. Perhaps if the experimental 
test were more reliable, there might be a closer corres-— 
pondence between its results and results on a reading test 
of known reliability. 

A third possible inference is that the low corres- 
pondence between Reading Test scores and Poetry Test scores 
ue duesuneparts tovthe fact®that the’ Poetry Test Stresses 
response to individual words and expressions rather than 
comprehension of a whole poem. If the operation of poetic 
janguage is regarded as essentially the same as the opera- 
tronVor "everyday language, 1t might beUargqued that the 
Poetry Test is somewhat lacking in validity, and hence will 
not produce responses corresponding closely with responses 
on a valid Reading Test. It is just this assumption which 
GhaptermilLi-attempted to refute, because’ the present sScudy 
iseelarge lys basedvon the opposite premise, Awew, sthatvethere 


are fundamental differences in the operation of "poetic" and 
Udiscursuvyers language: anda thatevavrailice to investi gave and 
understand these differences is a major obstacle in the 
teaching-of poetry. ~Lfethese last assumptions are walid;, 
andetieePoetrys Testis valid; then the relatively low 
correlations between Poetry Test scores and Reading Test 
scores reported in these results are not unexpected. 


A final possible inference arising from the data 


presented in Table XXXIX, and to some degree from all the 
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data relating to the Reading Test, is that the Reading Test 
itself, although reliable, is not sufficiently comprehensive 
in measuring the various kinds of language meaning to be 
considered completely valid, and in fact measures only part 
of the total spectrum of reading ability. Particularly in 
the Vocabulary section, it appears to this investigator 
that important aspects of word meaning, chiefly relating to 
connotation, are not adequately measured. In determining 
COswhat~ extent peeiuc languages seansextencionsof,erather 
Enangota ferent ingkindstronpmordsnarvyadlanguage,) miteacee isc 
necessary both to have an adequate conception of the nature 
of “ordinary language" and to have valid and comprehensive 
instruments for measuring response to ordinary language. 

Tables LXV to LXX in Appendix D present a 
detailed analysis of variance results as they relate to the 
various subtests of the Poetry Test and the Reading Test. 
micnougihwethese data are generaldy diffacult, to incerprec 
because of the lack of statistical equivalence in the test 
forms, two generalizations seem warranted. 

First,eccores: in the Vocabularyessubtect sol whe 
Reading Test appear to be a better predictor of success on 
the) Poe tryatest. ine general. than arey scores) on) thes Compre- 
hension subtest, particolarlyeasethey relate sto Subtest Four 
(meatrenendechythmsese This issnot-unexpectedeins views otmthe 
fact that the Poetry Test emphasizes sensitivity to the 
various meanings of words and expressions more than a global 


understanding of "what the poem says". Thus it seems natural 
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that the Poetry Test would have a closer relationship to the 
Vocabulary rather than to the Comprehension part of the 
RéadingeTests” Itsis*possible, “of course; ‘that theoskill 
measured by the Vocabulary subtest is more closely related 
to general intelligence than that measured by the Compre- 
hension subtest. This would also result in a greater 
correspondence between Vocabulary scores and Poetry Test 
scores than between Comprehension scores and Poetry scores. 

Second, there is a tendency for Reading Test scores 
eonvpes=relateda: moretclosely.tolscorestonePoetrysSubtestcvone 
and Four than to scores on Poetry Subtests Two (Suggestion) 
and Three’ (Sound). As Tables LXV to’. LXX. show, in the six two- 
way analyses of variance involving Reading Test totals and 
subtotals, Reading Level (including Vocabulary Level and 
Comprehension Level) contributes significantly to the total 
variance three times for Subtest One (Thought), once for 
Subtest Two, not at all for Subtest Three, and three times 
favesubtest: fours (Rhythm) y pAlthough@thesresultsicognor 
attain statistical significance, Reading Level also makes 
Sneiiporecantecontribution Lo®thestoral yarianceyongone 
Senerscccasi0on, Lorgsubtest Four. 

That success on the standardized reading test is 
generally a better predictor of success on Subtests One and 
Four than on Subtests Two and Three might perhaps be explained 
by postulating that a common skill, perhaps akin to @nalyta— 
cal skill or the ability to make inferences, lies behind 


both Reading Test success and success on Poetry Subtests One 
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and Four. On the other hand, Subtests Two and Three seem to 
tap skills which demand a more comprehensive conception of 
cognition than that set forth by Bloom and his associates-- 
skills which include ability to respond to sensory stimuli 
atedsbiecnent@leversno® consciousnesstdandtwhitch aremreliated 
to both the intensity of a response and the way it is 
organized with other similar responses for integration into 
the individual's total mental organization. 

Arguments for the need for more effective instru- 
mentation for exploring this latter type of mental activity 
(the type with which Subtest Three (Sound) is most closely 
associated) appear to be supported by the data presented in 
Tables LXV to LXX in Appendix F. Here again is an area 
requiring» further investigation. 

In examining Tables LXV and LXVI in Appendix F, which 
present Scheffe's Multiple Comparisons of Reading Level 
Erfects,~ it might be noted that these comparisons show 
Significant differences in performance for the three reading 
levels (1, 2, and 3 representing the top, middle, and 
botocom thirds, by Reading Test totals) on Poetry Dest 
Subtests One (Thought) and Four (Rhythm) but not on Poetry 
Subtests Two (Suggestion) and Three (Sound). This supports 
previous remarks about the various relationships between 


Reading Test scores and Poetry Subtest scores. 


ae Scheffe, The Analysis of Variance (New York: 
Werey; mo6s) prprell2: 
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For performance on Subtests One and Four of Form A 
there is a Significant difference between students in the 
top group (according to Reading scores) and the two other 
groups. For perforamnce on the same subtest of Form B, the 
Significant difference is between the bottom Reading group 
and the other two groups. A possible explanation for this 
Eesult may be that Subtest One and Four items in Form A 
are more difficult that the corresponding items in Form B 
and thus more apt to distinguish between generally high- 
ability students and those of medium or low ability. This 
explanation is supported by item analysis data (see Table XI, 
page 106), which show Form B means for Subtests One and Four 


to be higher than the corresponding means for Form A. 


Equivalence of Form A and B Groups 

Table XLI presents a comparison of the three 
Reading Test scores achieved by students taking each of the 
Poetry test Forms. This“data’ 1S a “useful "Check on the 
randomization procedure used in administering the two Test 
Forms. The similarity of all the pairs of figures, 
particularly the mean Reading totals for the total groups 
taking the Poetry Test Forms (73.7 for Form A as compared 
with 73.0 for Form B) indicates a high degree of similarity 
in verbal ability and reading comprehension between the A 
group and the B group. This SImiL larity ScLOongly ssuggeses 
that any disparity between performance in Form A and 


performance on Form B is due to differences in the test forms 
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TABLES Xli 


Reading Test Means and Standard Deviations: 
Comparison of Performance by Students 


Taking Form A and Form B of the Poetry Test 


Reading 
Test Data 
Vocabulary 


Mean 
Se DY 


Comprehension 


Mean 


Spee Bis 


Total Group 
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themselves rather than to differences between the two groups 


of subjects. 


Summary of Group Performances 

Ingansaltempt to .obtainsiurther.inftorumationmsabour 
the skill or skills measured by the Poetry Test and its 
subtests and to arrive at a clearer conception of the 
construct under consideration, relationships between the 
experimental tests results and grade level, reading ability 
and Sex were explored, ee cli by means of the two-way 
analysis of variance procedure. The results indicate that 
the relation between sex and the skills measured by the 
Poetry Test is not significant statistically. On the other 
hand, the relationship between grade level and the skills 
measured by the poetry test is highly significant. The 
relationship between reading level and Poetry Test perform- 
ance, aS indicated by scores on the Nelson-Denny Reading 
Test, was chequered--sometimes highly significant, sometimes 
apparently important, sometimes non-existent. 

Of these relationships. the conesconcernandieneadimg 
level is perhaps the least predictable. However, it seems 
to be of most impont, in determining, the nature; of the 
construct under investigation, and is the most productive 
source of inferences possibly leading to further investi- 
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FACTORS IN RESPONSE TO POETIC LANGUAGE 


Introduction 

In attempting to gain additional insight into the 
nature of student response to poetic language, as measured 
by the experimental test, the raw data were submitted to a 
principal components analysis? and a subsequent orthogonal 
rotation to the varimax criterion. 

dne basic function Ofstactor analysis, as noted mby 
Eysenck, is to resolve "a set of descriptive variables into 
a smaller number of categories” by simplifying a correlation 


° "Under 


matrix by the use of a mathematical technique. 
certain circumstances," Eysenck says, "factors may be 
regarded as hypothetical causal influences underlying and 


determining the observed relationships between a set of 


VarlLabrecas lt 1S-Oiry when regarded inethis light that 
they have interest and significance for psychology." 
Eysenck stresses that "cause", used in this context, "is a 


concept which aids in the simplification and unification 


Heenatoca lephenomena,. “and that. (a scientiile concept iis 


Tyenry H. Harman, Modern Factor Analysis (Chicago: 
Chicago =University Press, 1967)™ 


cus Ts Kaiser, “The VarimaxCriteriasror Analytic 
Rotations on Factor Analysis," Psychometrika 23, 19536, 
oa aU0s 


oir J.Eysenck, . The Logical Basis 7oO£ tractor Analysis 
fhondon mathe University of London, 196/)) pp. 659. 
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not a part of nature: it is rather a way of comprehending 
nature. WapheyturtherSnotessthatemucheot the classificatory 
and diagnostic work in such fields as medicine "is 
essentially of a factorial kind, although lacking the rigor 
andeexplicitness of@factor analysis , "and Sbelieves thateha 
more formal use of these recent mathematical developments 
WEES itiprevermoré-intuitive® ’clinicalitypes"of analysis."* 
Viewed in a slightly different way, factor analysic, 
Hike other Statistical "procedures *is#¥a 8usetul “means* both 
for suggesting and testing hypotheses. In performing these 
functions, however, as Eysenck notes, because "it provides 
abeinitio sdata relevant ‘tothe formation ‘of i”. . hypotheses, 
and rules out a large number of possible hypotheses which 


Might otherwise have been entertained," factor analysis 
appears to be of particular usefulness in a relatively 
unexplored field), because of its ability to "accelerate 
the formation of reasonable, worthwhile hypotheses, and in 
adEscarding poor ones." 
Nesiorpmthe "tes ting eas Moppescd Gro stheoegenerating, 
of hypotheses, Eysenck notes that "there are a number of 
hypotheses, particularly those concerned with structure and 
organization, which require factor analytic methods, and 


which are difficult at the moment to disprove or support 


by nonfactional methods. All type--and trati==nypotheses, 
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Applying these general comments to language teaching 
in general and poetry teaching in particular, it would appear 
that factor analytic procedures have much to offer not only 
in supplementing present methods of generating and testing 
hypotheses, but also in suggesting new methods of generating 
hypotheses and providing previously unavailable means of 
testing them. 

fC WacecOnecended sib. Chapters al sand. bathatesound 
teaching procedures depend on accurate knowledge of the 
domain and constructs relevant to what is being taught. 
Accordingly, the sound teaching of poetry .depends on 
accurate knowledge of the nature of poetic language (the 
domain) and of the way in which pupils respond to it (the 
constructs). If, like I. A. Richards, we believe that 
Maacnosiscno. Leaders! sdiffticulties sn apprehending ~poeric 
language is essential in poetry teaching, and if we can 
assume that accurate diagnosis is made possible only by the 
NOsO logical function, by accurate, categorizationsnGigco 
Muchsaseitvapplies to the. specialized ;techniques ofspoetry, 
but as it applies to the ways persons respond to poetic 
language, the importance and promise of factor analytic 
techniques for research relating to poetry teaching seem 
clear. Factor analysis, in reducing the bewildering number 


of descriptive variables relating to something as complex 
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as poetic language to a limited number of categories or 
dimensions which may be regarded as corresponding to "causal 
influences" underlying the observed relationships between a 
set of variables (in this case responses to individual 
items); needs to be explored in relation to the diagnosis 
Ofenupi daftficulty angreading ~ectry. “Invother words, 
factor analysis»promises ito throw light on the disease 
PeeCnCTethanetheysymptoms smlemcraterticult to cure the 
duscasesby treating» the symptoms, and it®seems that this, 
lacking the knowledge necessary to distinguish between the 
two, is just what poetry teachers all too often attempt to 
do. The lack of this kind of knowledge is precisely what 
Richards attempted to point up in connection with poetry, 
and it is unfortunate that so little follow-up has resulted 
from hs work. 

This study, like other studies of the basic nature 
GGelanguage and of vresponse to language, attempts to explore 


what could be considered a "new" field. Because of the 
Btutendans, dearthnoteknowledage About they construcc, under 
eet in i.e., response to poetic language, the 
factor analyses performed on the test data appeared to be 
perhaps less®profitableysinsterms o£ clear resuits, but 
much more promising, in indicating future directions for 
research os for the generation of new hypotheses, than 
other aspects of the study. Accordingly 7 only saepartwos 


the considerable volume of factor analytic data generated 


is reported in the present chapter. 
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Principal Components Analysis 


Principal components analysis is used in the present 
study to "determine the minimum number of independent 
dimensions needed to account for the intercorrelations 


among the original set of variables." 


The problem is to 
ldentify meaningful dimensions in a multivariate domain. As 
Gootey and Lohnes point out, this kind of "construct-seeking" 
Cask 1S gmosteirequentiyeaccompl ishedetoday by efirst 
conducting a principal components analysis and then using 

chee LeSuLciInggpEineppal ‘factorstas ta set.of references for 
determining the simplest structure, or most easily inter- 
Mreceoletset.of factors, for the domain “in question." 


Algebraically, the basic linear model for this 


analysis can be represented as: 


Bas = ne + eon Cee Se re ee ae as) 
Where 
ao ioe the standard Score fom andi vidual Sione ces umd. 
ope is the component (factog) loading of test jgon 
component w(facton), nr: 
Feh io sthescomponent i (factor) scone for individual i 


for component (factor) r. 


The observed variables (test items) are thus described 


Si Cooley and Paul Lohnes, Multivariate Procedures 


for the Behavioral Sciences (New York: Wiley, 1962), 
meme lLoO- OL. 
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finearlyein= terms of factors? or components. Each addi- 
tional factor makes a maximum contribution to the total 


VarlLance orPtne remaining 'variables* 


The above model can be expressed in matrix terms 


as: 
Z = AF cee es) CAI Z,) 
where 
Z°=~standard Score matrix Of Order (nexeNn) 
Av= a matrix? os component loadings ofworder s (nexer) 
(seerTables* xXnhigd,exXD Ia.) 
F = a matrix of component scores of order (r x N) 
and 
N = number of observations 
n = number of variables 
Yr = number of components 
ties = AF is postmultiplied by its transpose and then 
divided) by Ny the correlation matrix R is formed: 
' ea . 
a a oe ee 
= iy the identity Matrix, 16 the: component (scoressare 


scaled with zero mean and unit variance and are orthogonal. 
Prder these conditions, expression 4.3 reduces to -R =A A". 
The matrix A is then determined by a principal components 


analysis of R. 


Pies Varimax RoOcation 


Lnemie tiple: Tactor analysis, a procedure such as the 
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principal components analysis is frequently followed by a 
rotational scheme designed to "convert the obtained DEINeAS 
pal factor pattern to a pattern of simple structure." One 
of the most commonly used of these rotation schemes, the 
Varimax solution, was selected for the present study 
because it has the advantage of "cleaning up" factors 
Gather thantvariablesysine. ,sitretends tosyieldehigh loadings 
on each factor for a small number of variables and very low 
loadings on the remaining variables. This loading pattern 
EeendsetOesampliaty |adenti ficationsanduanterpretationro£ethe 
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Factor Analysis Results 

Strictly speaking, the experimental test designed for 
the present study fails to meet optimal criteria for pro- 
ductive factor analyses. The sample is of insufficient 
Size, there are too few items in each test form, test 
reliability does not appear to be sufficiently high, and 
there is a lack of clear cut hypotheses. These deficiencies, 
however, are to a large extent due to the nature of thegarea 
pected eandsto the basic form of the test. Whites the uses 
fulness of factor analysis for the present study may be 
limited, thus prohibiting a clear delineation and descrip- 


tion of factors in response to poetic language, certain 
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tentative interpretations seem warranted. 

An extensive examination was made of rotated factor 
loadings of each of the items in each test form, proceeding 
by the usual method of noting the items with substantial 
loadings on a given factor in contrast with other items 
with low loadings in the attempt to discover common features 
of the cluster of items: not shared by another group 
Analyses involving various rotational transformations of the 
principal components solution based on both Pearson and 
tetrachoric item intercorrelations were performed, first 
FOLmCOULLaAcCtOrs Or dimensions, and then form three factors. 
Separate analyses involving all the above mentioned varia- 
tions were performed, first on total test data for each 
form, then for data provided, successively, by each of the 
Pacer CLOupS, oye che top-halit .scores and bottom—na Ligscores:, 
and by various, combinations of subtest scores. 

incerpletcatiton Of snes datasgenerated by valet nese 
procedural Variants appeared most consistent for the three- 
factor analysis of the Pearson product-moment item inter 
correlations for the whole-group data. 

Aside from considerations of interpretability, the 
decision to retain three factors was influenced by the fact 
that the addition of a fourth factor did not appreciably 
increase the per cent of trace. 

Tables XLil and XLI1I present the respective results 
produced by this procedure for Form A and B items. 


Table XLII presents eigenvalues, or fatent roots, 
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TABLE XLII 


Eigenvalues, Per Cent Trace, and Varimax Rotated 
Factor Coefficients for the Total Form A 
Pearson Item Intercorrelations 


First Six Eigenvalues 
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per cent of trace of the first three factors, and varimax 
rotated factor coefficients for Pearson correlations for 
tota Paqroumiscores on: Form’ iA -items: 

From this table it will be seen ‘that items 9; 11, 
irasond el SeeloadwhighwoniFractorel:. atéens 6:, <6, “anduil’é load 
Boney sieghyronPactoual; candei temeisin el 0if and possibly 15 
MO CmLOwmorny MaCclom [avemLtems #5, @2nk5 “aridem load highvon 
Bacco nm Veasntem I4soloader amr hyihightom Ractoy Idkveand 
Hieelicaray anchi6 Sl oadialiow \OnaF actor eLhs leltems a7 53,, G4 780 
ance Oploady high oneactomelbi-mitemse2, Lea and sl6ilicad 
Patrivwlow On Factor ek! hi. 

Clearly, ~ehese actor rgroupings *cut, across gthe tfour 
test categories and subtests. There appears, for example, 
to be no single factor equivalent to "metrical sense", or 
to "sensitivity to sound or connotative values". These 
factors seem rather to reflect different modes, orm mental 
strategies which students use in matching these parts of 
Doensituo, thein isespective wholes. Factor 1 on -Form A; §thus, 
appears to load heavily for items (a) where this matching 
involves morerthan one styoe of clue-ing, =(bjmwhiere the 
clues tend to appear in the fairly immediate context, and 
(eye wheresboth eassense of sthe tpattermn ion thegcontext tana ga 
sensitivity to the flavour of the part appear about evenly 
necessary. Factor I appears to involve a blend of a 
conscious, analytical process and an unconscious, intuitive 
process, operating at various degrees Oesubmbery. 


Item A-9 ("Railway Train") for example involves 
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careful attention partly to the suggestion, but mainly to 
the sound, both of "peer", the "correct" alternative, and 
its immediate context, particularly "pare", the word with 
which it rhymes. Similarly Item A-1ll ("Fear no more") 
requires an awareness of the connotations of "reed", the 
part, and of the semantic requirements of the context, 
which™calts™tor‘an opposite’ to "oak". Item=13) (“T-did not 
lose my heart") requires not only awareness of metrical 
Pattern, OUL a Sensitivity tora subtle varlatvon=withine tus 
pattern, in this case a feminine ending, and to a subtle 
difference in suggestion among the alternatives. 

Unlike: Factor Ijaractor iL for Form A appears to 
Ravemiigi COGTLTCLeNtS tor Prems  Wiere Va)" CMe matching 
between part and whole involves only one type of clue-ing, 
(b) the clues tend to appear in recurrent patterns or in 
the larger context of the whole poem, and (c) a sense of 
the pattern (this could involve such things as metre, 
dramatic situation, recurring symbols, sustained metaphor, 
etcey ils tne main element. Factor Il= appears to involve 
aeitoniy Conscious, analytical process, Comprising Severad 
degrees of subtlety. 

As an example of an item loading high on Factor II, 
Peemen-eeappears LO require an understanding of the = general 
dramatic situation in the whole poem and of the denotative 
meaning of the alternatives. Here inteLring tic correc: 
meaning of the whole is considerably more demanding than 


understanding the meaning of the part. Item A-7 (from 
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"Tintern Abbey") also appears to involve matching using only 
one type of clue, in this case a conventional blank verse 
Pattern in» the context. 

Factor III appears to load heavily for items where 
(a) the part-whole matching process involves "stock 
response" associations and/or the routine applications of 
Simple formulae, (b) the clues are taken mainly from the 
Bteel or ~tlavoumssolsthesaltermnam vaeltceltyjrand tora very 
jamited dégree from the context (where they are taken. from 
the context, they are taken from its obvious aspects, such 
as Simple word repetition), and (c) a sense of the normal 
flow patterns of ordinary language is a main element. 
Pactor ee bleappears «tO besrelated sto a Vargely unconscious, 
intuitive process. 

In Item A-10, for example, selecting the correct 
alternative, contrary to the intent of the item, is simply 
emmaccereOrematcning "Christmas “iwith ‘Peace sand ~Goodwiits: 
Item A-3, intended to measure understanding of the meaning 
Giethe complete Sonnet, appears rather to measure on 
intuitive feel for the sound and suggestion of "loss of 
pneel mithice Correct. alternative, 

Tablewxubll presents Cata LOD FOLrm (evens irom 
Pie table it will be seen that items 7,9, .0cand 14) load 
high on Beeeor Te ateme 1 All3, send. 16 dcadeta val yehagneon 
Factor I; items 2 and 12 load fairly low on Factor I; and 
HeenGe loads low on Factor I. Items 2, 8, and 12 load high 
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LABLE AbLIL 


Eigenvalues, Per cent Trace, and Varimax Rotated 
Factor Coeifictents for the Totals Forms 
Pearson Item Intercorrelations 


First ols bigenvalues 
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Varimax Rotated Factor Coefficients 
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Factor II; items 1 and 10 load fairly low on Factor EET yaya 
Peeuiei@tOacs tow onjFactor iim items 1, 4,95, and 6 load 
Higheon@rac tomy Tl i1tems 3500 ,;8 andell. load fairly hilghwon 
Factor I1l; and items 2 and 9 load Eairly low on Factor Til. 

These factor groupings, like those arising from 
Form A, cut across the four test categories. They also 
seem to reflect the three types of mental strategies 
described in connection with the Form A data. However, 
while Factor fII appears to be essentially the same in both 
EOrmSsy. Factor fl and Li for Form Avbecome Factors Ti anda 
tObsFrOrm Be  -beCause Of this apparent reversal ofeorder, 
the basic factors or constructs underlying the factor 
structure of both test Forms have been labeled A, B, and C. 
PRecOLLeSPONAUS LOL Paccor= La ton Form A anderactor Sigon Morn 5. 
BeCcOLLeSDOnNaSItOeractor Lon Form A and Factor 1) cn gouges. 
G8corresponds iz0 Factor Lii.on both Test Forms. 

Table XLIV presents a conceptual model based on the 
dave trommables XULl and “iiil, and conrirmed by ~ene daca 
presented in Tables LXXI and LXXII in Appendix F. Table 
XLV lists items from each Test Form having high or low 
iWoadings on any of the three factors. 

To give a clearer indication of the characteristics 
etmeach som the Factors Ay B, and C and of the process which 
led to their general description, as well as to support the 
conceptual scheme presented in Table XLIV, items with high 


or low loadings on each of the factors are now discussed in 


some detail. 
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TABLE XLV 


Items from both Test Forms with Varimax Rotated 
Factor Coecrricients of More. than, 230 and Less 
than -.25 for Pearson Item Intercorrelations 


Kactons A InyskeneOe  !5) IneKeicione (© 


Item Source High Low High Low High Low 
Form A Item EP ays cy nee ipestaeue 
Numbers Bsus oes Ata sae haa 
14 12s 10 16% 
Tso 
Form B Item Fe nS 2885 7 ieee eek 
Numbers TOs Liss 45 eo 
117, L2F pee 
145 14%, 9, 
16 15 


Note: 


Lteems wath fairiyipArohyviloadingsyontother factors 
Dtems. loading higher on one other factor 
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pasos SW teh gid Pi ean ebactousAy loadings a eCnehices2 
items in the total Poetry Test (Form A and B), 11 had Varimax 
rotated factor coefficients of 0.30 or more for Factor A. 
This compares with 13 items Om Hacborpebyand tl2 ei.temeamnhor 
Factor C. As can be seen by examining the unrotated factor 
Nat ercesseronelormssA,and-B. (Tables LXXI and IXXIT in 
Appendix F) this similarity in the number of items with 
high loading reflects the tendency of the Varimax rotation 
to redistribute the loadings more evenly on all factors, so 
that iat would be misleading to conelude from these Varimax 
Eigures that cach of the three factors accounts fora 
Bairiy equal per cent «of trace. 

Orathne total of Tisai tems) wi th high coerticienisson 
Bactor A, .one. (B-11) loaded equally high or higher on twe 
Geecicsocrer tactors , “makingpsinterpretation dir oiculic sO. 
the remaining 10 items, two (A-5 and A-7) involve a metri- 
eaepatceern- | two. (B-/ and, B=14)) involve; both metrical wand 
stanzaic patterns; one (A-1) involves a conventional 
rhyming pattern; two involve the total dramatic or plot 
pattern of a poem (A-2 and B-13), two appear to involve 
either simple word recurrence (B-9) or recurrence of words 
with similar meaning (B-16); and one (A-14) appears to 
involve an alliterative patterning. The significant common 
element ee these items seems to be the relative import- 
ance of a particular contextual pattern in matchangecne pane 
to the whole. This seems to apply whether the difficulty 


level of an item is high, as in A-14 (ORC 7) €or wlow, asain 
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Items with low coefficients on Factor A (A-4, A-6, 
B-6) confirm this "pattern" hypothesis. For these items 
the matching process appears to be governed by the very 


strong suggestive and sound values of the part as opposed 


Eos thes patterni of the whole: 


Se CUS EWES OM CaO Ue ot orb Poad ings Oat le 
f Ltems with high coefficients on Factor B, two (B-1] and 
B-14) also show high loadings on Factor A; three (A-8, B-8, 
and B-11) show high loadings on Factor C; and one (B-11) 
shows high loadings on both of the other factors. Factor B 
appears mere icomplex than Factors Avand Cy, involving a 
DliendsorepabtLern recogni t2zonyand Sensitivity to thie flevour 
of individual words and expressions. 

Of these 13 items, three (A-13, A-16, and B-14) were 
intended to measure response to a metrical pattern; two 
(A-12 and B-8) appear to relate to "tone"; two (A-9 and 
EP-l5jereravre to hali-rhyme, ch slant-rhiyme » three mseenmce 
relate to compact verbal patterns, involving metaphor 
(B-14) and analogy (A-1l1 and B-2); and three involve the 
sound and connotative meanings of words and expressions as 
these meanings relate to the more-or-less immediate context 
(A=Oe@A-GeandsB-12).0 It wouldgat first seemilikely {thar 
the "metre" items (A-13, A-16 and B-14) would load high on 
Factor A rather than Factor B, but a close examination of 


these three items reveals that in two cases (A-13 and A-16) 
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the metrical distinction between the two likeliest alterna- 
Lives@is@extremelyasubtle fandethatein) the remaining case 
(B-14) the metrical pattern seems too involved for the 
student to cope with. 

Thus, although these last three items purport to 
measure sensitivity to the metrical use of language, they 
may in fact measure sound-connotation values. The same 
transfer seems to operate with respect to items A-9 and 
B-15, which were intended to measure awareness of half- 
rhyme. Because students were virtually unaware of the 
operation of half-rhyme, selection again appeared to be made 
on the basis of the sound-connotative values of the various 
alternatives. 

In cases such as the ones discussed in the preceding 
paragraphs, where what is being measured is of a highly 
complex nature} factor analytic techniques promise to be 
an invaluable complement to intuitive judgment in indicating, 
and hence diminishing, the discrepancy between what an item 
purports to measure and what it actually measures in terms 
OLmunderlying psychological Constructs. It appears from 
the results emerging from the present study that face 
validity, whether or not supported by knowledge of subject 
Matter, is not sufficient by itself in this kind of testing 
Sbcuatson. 

Items with low loadings on Factor B (A-1l, A-10, and 
B-7) also serve to support the description given above and 


presented in Table XLIV. These items clearly fail to 


require any significant degree either of analysis or 
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word-sensitivity. Rather, they appear to involve the 
routine application of a formula, (A-1), a Simple stock 


response (A-10), or the recognition of a very Simple 


pattern?! (B-7). 


eS i ee ee ec ore e lod ie eae 
U2 Conse tOading highvonskactom ic, two. (Ad) ands A—9) appear 
to involve the routine application of a simple formula. For 
A-1l this formula has to do with rhyme and for A-8, with 
elliteration. sitem A-l0 clearlyeinvolves the routine 
aqssocration Of Peace and Goodwill” with “Christmas”, ana 
item B-3 possibly involves the same kind of routine associa- 
CLOVE tiis ecime OF ‘cars swith “ights". ~Botheitems were 
designed to measure ability to make an inference from the 
total situation presented by a poem, but this intent was 
apparently frustrated by the "stock response" phenomenon 
which has been noted by Richards and others. 

The remaining eight items appear to involve the 
selection of an alternative with little or no concern for 
Enewcontext or Lts Contrasoution to the “otale poetre errect. 
Rather, the selection in these items seems governed 
primarily either by the attractiveness (vigour, smoothness, 
etc.) of the alternative in atself or by the ease with which 
the alternative fits in with the flow of everyday speech. 
The former effect is seen in items A-4, B-5, B-6, B-8, and 
B-ll; the latter in items B-l, B-4, and perhaps A-3.5 SCC 


also seems likely that both these influences are at work in 
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some items, such as A-3 and B-l. 


Because of insufficient data these remarks, pasti-= 
cularly as they concern items with high Factor C loadings, 
are highly tentative and speculative, and subject to further 
more detailed investigation. 

Items loading relatively low on Factor C (A-2, A-1ll, 
hoo, B=2, B-9)\ all appear to involve a selection involving 
an analysis of context and a high degree of awareness of 
various kinds of patterns in the context. That these items 
all toad high on one of the other two factors would seem to 
SUpPOFE the Scheme set forth an Table XLIV: Ttem A-2, for 
instance, which loads low on Factor C loads high on Factor 
A. This item ("The Fiddler of Dooney") seems to be con- 
cerned with a fairly high degree of awareness of the total 
meaning of the poem (Factor A) and not at all concerned 
with any kind of stock response or unconscious awareness of 
sound or suggestiveness in the alternatives (Factor C). 
BecneB-2,ewiich also loads low on Factor C, loads hagh ton 
Meactor Br) Enis item (Others, I am not the first) 2s 
concerned both with the completion of an analogy (ice is to 
fire as is to desire) and with the association of 
"ice" with "fear" rather than "guilt" (Factor B). No appli- 
cation of a simple formula (Factor C) will serve in this 
case. 

It should be pointed out that all the items, and 
not merely those examined in the following section, load 


to some degree on more than one factor. This would suggest 
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that the item interpretations are complex, and that each 
item involves two or three (or more) complex psychological 
CONntanuc ern bts =interpretataone in tthe ErgntOtathe 
complexity of poetic language the irregular pattern of 


factor loadings for the present items is not unexpected. 


items with high Voadings on “all factors. “An 
Sxaminatvonsor tems B=5 "and. B- Ll, which Voadenigh oneal! 
three factors, seems to lend further support to the conten= 
ELON tliat spostry “interpretation is ‘conplex an natures In 
mean b—-o pune —selection of tthe Yeorrect) "al ternative comld 
have reasonably been based on a large number of different 
eypes' "Ol =clues.  The™“intent of the item was “to measure 
students' ability to match the sound-connotative value of 
"gleaned my teeming" with similar values running throughout 
the whole poem. “But the actual selection of the response 
could have been based on the denotative connection between 
boleaned™ fang grain’; or simply onthe attractiveness 
(smoothness, richness, misical’ quality) of “the=pnrase 
itself. Me same considerations apply “to 1tem B-Il; where 
Ncorl s=thee"righe answer, could -have been vselected "because 
of the sinister mood of the whole situation developed in 
the poem, or simply because snakes hiss and coil and strike 
atepeople"s legs.’ Thus for both items selections are likely 
to be made based on very different uses of context and at 
very different points on an analytical-intuitive continuum. 


Although of limited usefulness in delineating and describing 
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elear-cut,factors,.such items are interestingsacttrancy 16% 
catch-alls, for various mental strategies, and perhaps serve 
as a useful reminder that there is no NeECe ssa waetciice 
way of getting meaning from poetic language. 
Pntcerprecatzon of the Factors in the 
LigntwoleProeis ci Theory 

Introductory comment. C. §. Lewis, in distinguish- 
Boome Wee literary sang) ‘unliterary } readers,* speaks of 
Breceiving,! the stimulus produced by a work of artvas 
Opposed to merely "using" it. As examples of "using" he 
cites extracting a tune or a vague emotion from a symphony, 
aesentiment £rom a painting, a plot from a novel. ‘This 
Busing, fe Says, 1S not-a.bad thing in itseli* at simply 
Pie SsmLOmacsk, OL) aA WOrk Of art the main thing, witch could 
be called aesthetic experience, it has to offer. In order 
to participate’ in this experience the viewer, or listener, 
Or reader, must "receive". In the case of a poem, he must 
allow the words to do their work on him. He must approach 
poetic language in a state of high awareness but also in a 
State Of paSSivity. One of the central assumptions under=— 
bvingethis investigation 1s that a basic obstacle to 
adequate response to poetic language is a faulty set of 
expectations on the part of the reader regarding the function 
Of wordswas they occursan ap poem: Thespoet, byathesynatuxe 
of his art, must deal in words that are most commonly used 
for their power of immediate association. Normally words 


coe See tewis, An Experiment’ in Critieismea(Cambridge 
University Press, 1961), Chapter Il, pp. poo— 40% 
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are not sSavoured or seen as a source of new meanings or new 
experiences »Their role in the business of daily survival 
PendscucoeLloubid Pts, 

Not so common, but still much more common than the 
poetic use of words, is their "scientific" use. “Here 
precision of meaning and a high degree of conscious analysis 
avoebequined.@ Wheretdallywlivingstends "to train people in 
the "stock-response" use of words, formal education tends to 
Eecitimeuremvin this’ "scientific", on analytical, or logical 
use. 

Phe thi rdeuse of words@could bemtermed “poectiabror 
bli terary.sorbecause Ttmis *noveso obviously Necessary for, 
SuLvEval,aor becalise WET OrLen suns counter etomtherothes 
uses, or because in incorporating and surpassing the other 
uses it demands more of readers and listeners, it tends to 
be neglected. 

The importance of this neglect must be determined by 
aesociety Was “a ‘whole, ‘but its» exact nature and cure Cit Btls 
Menwiaeeis: desired) isthe responsibility \orscritics, 
teachers, and researchers. Invany “case, no remedy ror 
this situation is possible without much additional informa- 
tion regarding the nature of response to language in general 


and «to poetic, or literary, language in Parerdoulane 


The nature of the three factors. In undertaking an 
PINS OUI ae i dee a srt eee tar eh a asia AE 
investigation of the nature of response to poetic language, 


this study, because it is largely exploraclory, 1 seconcerned 
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with generating hypotheses for subsequent investigation 
rather than with testing hypotheses. The factor analyfie 
procedures described in the preceding section produced three 
factors which appear to be amenable to a conceptual scheme 
which has’ al fairly highdegree of, face validity and internal 
consistency. This scheme confirms reasonably well the ideas 
concerning the nature of poetry presented in Chapter II and 
appears successful in suggesting certain possibly useful 
hypotheses. 

In terms of the three broad uses of language, the 
gevenyoay  ,Lich scl entitivci, tand, the “poetic iethere fappears 
VoOMbDestds SLCLOnG connection betweemmacton Al and the 
"Scientific" use of words, between Factor B and the "poetic" 
use of words, and between Factor C and the "everyday" use 
of words. As is shown in Table XLIV (page 229), Factor A 
appears closely associated with a highly analytical kind of 
response appropriate to the "Scientific" uses of language; 
Factor B with the multi-level type of response appropriate 
EO tpoetic™ uses of language; and Factor C with the mainly 
routine, conscious type of response appropriate to the 
"everyday" uses of language. 

On the basis of the conceptual pattern suggested by 
these factors it should prove possible to devise measuring 
instruments, perhaps similar to the one used in the Study, 
in which individual items are systematically constructed to 
load high on the respective factors. Subsequent analysis 


might suggest additional component factors and generate 
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further hypotheses. 

In ‘the present study, Factors A and B, corresponding 
to "scientific" and "poetic" uses of language, involve 
items which are considerably more difficult than Factor C 
(everyday language) items. Also, there is a greater per- 
formance gain between Grade X and Grade XII for items 
loading high on Factor A, and a much greater performance 
gain for items loading high on Factor B than for items 
foadings high on Factor,C. Thesesfindings ,~presented. in 
Table XLVI, tend to confirm the conceptual scheme outlined 
Garlier. It might be noted that by far the highest Grade 
X-Grade XII gain is for items loading high on Factor B, 
which has been tentatively identified as corresponding 
more closely than the other factors to the "poetic" uses of 


language. 


Summary of Findings Relating to Factor Analysis 

Aewa resiwit of the factor analysis, cer iain mau 
findings emerged: 

Peerhreecareasonal ly dislincuncaGrOrswi ie teoc pense mee 
poetic language as measured by the experimental Poetry Test 
were identified and tentatively described. That these 
three factors account for only 31 per cent of trace for 
Form A and 35 per cent of trace for Form 2 St EOng hy, 
indicates the presence of further, somewhat less pronounced 
factors within the construct under investigation. 


2. The factor loading pattern for the various items 
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is irregular and difficult to interpret. A few items have 
high loadings on all three factors, and several items have 
high loadings on two factors. Most of the 32 items show an 
appreciable degree of load on more than one factor. This 
complexity appears to reflect the complexity of the skill 
or set of skills measured by each item and is not unexpected 
Momy teow On tie intrrcacy Of poetic language. 
3. “Ine irréguilarity of the factor—loading pattern 
Popa cOerer tected an the outcome that the three Lactor 
groupings largely fail to parallel the four test categories. 
This, more than anything else, makes accurate description 
Gime uemtibee 1Centiried taGrors ditlicult, ano suggecus va 
serious lack of correspondence between the intent of the 
various items and the process of responding to them. 
4. The skills associated with the three identified 
factors were tentatively characterized as follows: 
actor Ac, Higqniy analytical, Nigh” level of “awareness, use 
of Single—-level clue-ing, use of larger Context or 
recurrent patterns; Major Stress On pattern and 
form, and emphasis on the “whole” rather than the 
‘Veve bea ee yy 
Factor B: Partly analytical, partly intuitive; fluctuating 
levels of awareness; use of proximate context; 
generally difficult; equal reliance on "whole" and 
Baia. 
Factor C: Instinctive; low, mainly unconscious level of 


awareness; use of stock association and the 
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application of simple formulas; minimal use of 

context, with major reliance on the "feel" of the 

"part"; generally easy; associated with the 

habitual uses of “everyday" language. 

o-gethesthree factors described fabovesappeareto 
beralleiethe “scientitiowse"sofslanguage, (Pmactor PA) ithe 
Bprocticsusersot Language | (Factor 8) ,-and thesYeveryday use" 
oft Language + (Factor. C) ; 

63. The findings resulting from the factor analysis 
confirm the commonly held critical view (see Chapter ITI) 
that in each component of poetic language, even at the 
Single-word level, several kinds of meaning are operating 


Simultaneously. 
CHAPTER SUMMARY 


the findings) relating sto (ljethe penieormanceset the 
experimental poetry test, (2) the performance by certain 
Gategontes Of indivvidualsyon thestestpeande(3)) factorsgin 
Eesponse to ~poe tic) Language ;wwere epresented in this ichapter: 
A brief review of these three groups of findings, summarized 
DPESGLOUEky son, pages 3195), 214), rand #240), Gis presented as 
follows: 

iy, Laln vicew lof itheseconplextty ofepoeticelanguage, 
the Poetry Test appears to be adequately reliable for 
investigative purposes. 

2. Examination of detailed item data reveals that 


the testing procedure used in the study is effective in 
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providing a wide range of reasonably exact information, at 
varying levels of sophistication, about the component skills 
in responding to poetic language. 

3. A possible weakness in the present testing 
procedure is that the interdependence of the elements 
operating in poetic language make it exLremel ye dicts teuld co 
construct items which reliably measure discrete skills. 
piiseas particularly.true forsther!Sound"sand- "Suggestion" 
categories. 

4, The generally low degree of correspondence among 
performances on the four subtests (the mean correlation 
coefficient is less than 0.2) indicates that the categories 
represent skills which, though interrelated, are decidedly 
discrete. 

5. The low correlation between total Poetry Test 
performance and Reading Test performance suggests that 
skilis involved in responding to. poetic language are 
substantially different from those involved in responding 
to discursive language at least, as measured by standardized 
Eeading Lests. .Also, the relatively greater, between-grade 
gains for the seemingly more reliable of the Poetry Test 
forms suggest that high school students' skill in responding 
to poetic language is increasing at a greater rate than 
their skill in responding to discursive language, perhaps 
mainly because the latter skill is already relatively well 
developed. 


6. A breakdown of Poetry Test scores by grade, by 
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sex and by Reading Test performance reveals that grade level 
is by far the most important variable, considerably more 
closely related to Poetry Test performance than Reading 
Level, and far more influential than Sex Difference, the 
effect of which is virtually non-existent. 

tee GEnGrally thei test 1s too difficult for the 
average student in the sample tested. Accordingly, it 
Hppears more suitabler form Grades xi than) fori Grades xX 
students. 

8.op Three factors in»response to» poetic’ language, 
as indicated by Poetry Test results, were identified and 
tentatively described. That these factors failed to 
parallel the existing test categories, and that the factor 
loading pattern is complex, with many items having sub- 
stantial loadings on more than one factor, suggests that 
each item measures a complex of skills. 

Ony Thesithree factonsy which weresaidentariedswere 
tentatively labeled Analytical (Factor A), Analytaical- 
Intuitive (Factor B), and Intuitive (Factor C). These 
factors appear to correspond with the "scientific", 
"poetic", and "everyday" uses of language. 

The following chapter presents the results and 
discussion arising from the follow-up interviews which 


accompanied the administration of the Poetry Test. 
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CHAPTER: V 
INTERVIEW RESULTS 
INTRODUCTION 


The main purposes of this study are first, to 
investigate student response to poetic language and second, 
to examine and develop means for examining this response. 
In accordance with these purposes an experimental poetry 
test was devised and administered to high school students 
and test results were analyzed in an attempt to discover 
possible patterns and relationships concerning response to 
poetic language. As a result of these analyses it was 
possible to suggest some tentative generalizations relating 
Lowwhy Certainvalternatives were*chosen?) Testable™hypo- 
theses for further investigation could be formulated from 
these: gqeneraligauvons. This will” betdiseussed in the final 
chapter. 

fie, purpose Of the “follow-up interviews 1s "to =supple— 
ment the knowledge gained from the analyses of Poetry Test 
Gesulvsepresented lin “Chapter “1V.~ Shercly atter chic 
administration of the test students were questioned about 
their own responses to thesvarvous test 1tems. = It was 
hoped to gain, through respondents’ direct perceptions of 
their own acts of selection, valuable additional knowledge 
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about the students' thought processes while reading a poem. 
At the same time the interviews would serve to provide 
additional information as to the validity and reliability 
of the Poetry Test itself. 

A description of the manner in which the interviews 
were conducted was presented in Chapter III. Briefly, the 
interviewing procedure consisted of a five-minute period 
for establishing an appropriate climate, a forty-minute 
period in which students were asked to explain the 
reasoning behind the selections in the various items, and 
a final five-minute period for any free response not already 
offered. While the questions and questioning sequence in 
the forty-minute "body" of the interview were structured and 
Similar for each respondent, free response was encouraged 
at all times. It was hoped that the resulting balance 
between structured questions and free response would produce 
an optimal condition for the gathering of information. 

As was described in Chapter III, the interview 
sample was selected so as to represent students achieving 
Yow, mearum, and high “scores on the Poetry Teese. The sample 
of ten students included two Grade XII students with very 
high scores (98th percentile); one Grade XII and three Grade 
Mestucents with high scores (above the 80th percentile); one 
Grade XII student with a score at the 50th percentile; one 
Grade XII and two Grade X students with scores between the 


20th and 40th percentiles. These percentiles were calculated 


within each Grade group. 
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Typescripts of two complete interviews, chosen from 
among the ten because of the ability of these respondents to 


express themselves, are presented in Part C of the Appendix. 


INTERVIEW RESULTS AND THE POETRY TEST 

Test Validity 

The results of the ten interviews conducted with 
students selected to represent a range from below average 
test scorers to very high scores tend to confirm the general 
Validity of the experimental Poetry Test. As Table XLVII 
indicates, the majority of the items on both Test Forms 
appeared to measure what they were intended to measure. 
Essentially, the interviews attempted to discover to what 
extent students could explain their selections within the 
various items and to investigate the reasoning behind each 
selection. Because the Poetry Test required students not 
only to make a selection within a given dimension, such as 
"tone", but also to determine which dimension was being 
measured before making this selection, it would seem reason- 
able that a high correlation between the selection of 
"correct" alternatives and the selection of these "correct" 
answers for the "correct" reasons would indicate a high 
degree of content validity. 

The data presented in Table XLVII were tabulated as 
follows. During the interviews three notations, one noting 
whether or not the original selection was accurately 


recalled, the second noting the "correctness" of this 
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TABLE XLVII (Continued) 


STUDENT BY NAME AND GRADE 


from Form A 


from Form B 
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Of1d1 Naeseidectcion, and: thesthiird noting the "correctness" 
of the dimension used in making the response, (Sana se 
and "0's", were made for each item for each interviewee. 
TablesxXEVIT is a compilation of these results, containing 
480 pieces of information, 48 for each interviewee. From 
the data presented in Table XLVII it was estimated that the 
correlation between "correct" responses and "correct" 
reasoning leading to these responses, exceeded 0.90. Put 
Pimiesligitiyrirererent way, 19.5) Out of ithe 929 correct 
enswerso feported in Tables xXLVil, or 87 per cent, were made 
Dyectudettomusing the corrects (dimension, swha te soniye. 
correct answers, or 13 per cent, were made by students not 
Using athe, CcOnmrece... dimension. "On the otherthand, of the 
68 "incorrect" answers reported in Table XLVII only 28, or 
41 per cent, were made by students using the "correct" 
dimension. 

An examination of the data presented in Table XLVII 
furehecesnows that a “total of 10/7 responses were madesby 
eMployingmtine ‘Correct. dimension. Of these 877 or e/> sper 
Centreprodiuced "correctUsanswers while only 27, or) 25> per 
cent, produced "incorrect" answers. However of the 53 
responses not made by employing the "correct" dimension 
only 13, or 25 per cent, produced "correct" answers, while 
LOL) per cent, produced incorrect answers. 

The relationship between correctness of response and 
correctness of dimension was calculated in the same manner 


for the four subtests and summarized in Table CGUAV/ULIE Ie, |< Ihe! 
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LABEE Ay cur 


Comparison of Correctness of Response with 
Correctness of Dimension for Poetry 
Test Totalsw ands subtotals 


Percent of Response Based 


Test ons “Correct” Dimension 

Answers Total eri Siw See} ST4 
Correct 87 90 80 62 80 
Incorrect 40 7 a a 7 


7 these percentages were not computed. 


TABLE XLIX 


Comparison of Correctness of Response with 
Correctness of Dimension for Items Loading 
Hignonsvactors 2) 2B prandec 


Percent of "Correct" Answers 


Dimension Factor A Hacktor 8 Pactorsc™ 
Used Ttems Items Items 

SOrrect 84 79 68 

Incorrect 14 2. 34: 
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was reasoned that Subtests One and Four, meant to measure 
responses which are more analytic and less intuitive than 
responses measured by Subtests Two and Three, would show a 
correspondingly greater ability on thespart of students 
interviewed to give "correct" reasons for areivindean 
"correct" answers. Of the total number of "correct" answers 
to Subtest One ("Thought") items reported in Table XLVII, 90 
per cent were made for the "correct" reasons. The corres- 
ponding figures for Subtests Two, ("Suggestion"), Three 
(SoOund jeand Four. ("Rhythm") are 30 per cent, 62 percent, 
SncmcUmpereCeCnt, respectively. The Lace that, thes ovubtresteene 
figure is noticeably higher than the Subtest Three figure 
appears to support the notion that "meaning"items involve a 
Bicone tedleqrec. OF Conscious thinking ‘than “sound Jeitensseand 
thus might be expected to result in a greater tendency to 
Perm wii Le esons fOr, raght! choices. Slhisspasiicusar 
Pomparlscon of the subtests indirectly ends support to: the 
Webi oyeOn the, Poetry ‘Test. 

Another approach which appears potentially useful 
involves comparing the relationship between "correctness" 
of answers and "correctness" of the dimension within which 
selections were made (see Table XLVIII) with the factor 
loading results presented in Chapter IV. This comparison 
is intended to illuminate and perhaps substantiate the 
interpretational scheme for factor loadings." Taple XLIx 
presents this comparison in summary FOr, mel Onetuece tures 


items from both Test Forms which loaded high on "Factor A”, 
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84 per cent of the "correct" answers coincided with the 
Bcorrecte "dimension. “For@=the four "Factors" items the 
corresponding figure is 79 Per #Cent™=and=for=thertaree 
BraccoreC IJtemsS7it is 68 "per cents 9¥Looked! at vim another 
way, 14 per cent of the Factor A "correct" responses, 21 per 
cent of the Factor B "correct" responses, and 32 per cent of 
the Factor C "correct" responses were based on the "wrong" 
dimension. 

These ditferences are considerable and appear to 
support the tentative conceptual scheme advanced in Chapter 
iveecO explain resuits Of the factor analysts. Tf !ractor A, 
as was suggested, involves a relatively analytic, highly 
conscious mental process, and Factor C involves a kind of 
intuitive associational response with a relatively low level 
of analysis, it seems reasonable to assume that interviewees 
would be more readily able to give "right reasons for right 
mesponses Lor Factor A items’ than for Factor C items s) his 
assumption was borne out by the figures presented above. 
muLeher, a Factor 8, conceptually, lies between the orner 
CVOmtaCctOrs, the /9° per cent figure Lor Fabor B items (as 
opposed to 84 per cent for Factor A items and 68 per cent 
for Factor C items) could reasonably have been anticipated. 

The interview results, therefore, appear to support 
the ee ie res results and interpretation presented in 
Eapter Iv. Again the validity of the Poetry Test seems to 


be supported. 


One further approach relating to the data presented 
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in Table XLVI is to attempt to determine whether the test is 
more valid for high scorers than TOTSLOWwASCOTeDs. mm it ecould 
be argued that purely random guessing is more prevalent in 
all types of objective tests for low scorers than for high 
scorers and that hence test validity would be higher for 
high scorers in all objective testing. Since, more than 
most, the present test is more directly concerned with 
investigating student response than with evaluating pupils, 
and uses "correct" answers as an indirect means of making 
inferences tabout response «patterns, ait aseparticularly 
WeuNiaolemeo ascertalmethiec accusacy with whiehmycomrect— 
Besponsen (patterns hxreflech e"correct sapproach"spatterns. 

it has been «suggested that for high “scoring ‘students 
the degree of coincidence between "correct approach" and 
"correct response" should be much higher than for low 
Scorn eStudenes Rand e:hatinn Elhis! sense jmetesteresiiitse sac .a 
whole would be more valid. for the high scorers. This: hypo-— 
thesis was tested by comparing the relationship between 
WCorrect manswersauvand "corrects diméenstoniuton the twosinter= 
viewees with the highest Scores and for the two with the 
lowest scores. Table XLX presents a summary of this 
comparison. For the high scoring students, 95 per cent of 
the "correct" answers and 75 per cent of the "wrong" answers 
involved the "correct" dimension, while for the low scorers, 
OnlyesOener -centeor the "Gorrect” answers and 35” per Cent of 
the "wrong" answers involved the "correct" dimension. These 


figures clearly support the idea that there is a closer 
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relationship between "correct" selections and "correct" 
reasons for making these selections for high scorers than 
for low scorers. In terms of the purposes of the present 
test, therefore, individual items generally appear more 
validerorghighescoringsthans foreilow! scoringirespondents. 

tieeshould besnoted that in? thesduscussiontofeanter— 
view results "dimension" denotes the student's strategy of 
approach tobangitem,«and. corresponds) tosonesof thesfour 
testocategories.: For example, if a student! approaches: a 
Penychlome CeMaonithepbasmesor rhythm, foremetre ,\hemastusing 
PhneecorrectLe dimensions) LAsmusedeherep., "dimensionversenot 
LOowbesconftusedcawith, 'factorsanalytic dimension'< 

However, because of the small number of students 
interviewed, the foregoing results must be viewed with 
caution. These results can only be taken as indicating a 


probable trend, and are obviously far from conclusive. 


TABLE XLX 


Comparison of Correctness of Response 
and Correctness of Dimension 
for) Highyands how Scorers 
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DesteRel sabia lity 

In addition to providing additional information 
about the validity of the experimental test, the data 
presented in Table XLVII provide information about its 
reliability. Because of the lack of homogeneity, the 
limited number of items in each test Form, and because the 
two Forms, wnich were meant to be equivalent, were dis- 
covered to be only partiaily parallel, standard procedures 
for determining reliability may be applied to the Poetry 
Hesteto Only a limited degree, The interviews, a part of 
which consisted essentially of retesting a small representa- 
tive sample drawn from the original test respondents after 
a lapse of from two to seven days, provided additional 
useful information about the test's stability, an important 
component of test reliability. In effect, the interview 
results made it possible to compute an approximate 
GochiivcienteoL Stability for the Poetry) Testeas a whole. 

Aseis Shown ini Table, .79 pemicent of thesinreiar 
testeselections within the various ltems were Correctly 
tecallequduring the interviews. Bighty-five perecentsot 
the “correct” responses and 33 per cent of the» incorrecr, 
responses were recalled. For the items in which the inter- 
viewee, whether or not he selected the "sorrect”™ answer, 
was operating in the "correct" dimension, 92 per cent were 
correctly recalled, while for items for which the pg yetsy et 


. : , " : 4 
viewee was not operating in the "correct dimension, only 


27 per cent were recalled. 
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TABLE LI 


Relation of Accuracy of Recall to Correctness 
of Answers and Correctness of Dimension 


[ZZ OOH 
Sg SE EE AE REDE TIA EEE RECO 


Per cent of Original Choices Accurately Recalled 


Correct incorrect Gerreci Tim OmeeGit 
Tota. Answers Answers Dimension Dimension 
Se ee ee ene ene 
79 85 Ss 92 2 


a a a eee 


On the whole then there appeared to be a high degree 
Giplecitustabatitys, This stability was higher tor @tems 
answered correctly than for items answered incorrectly and 
Hnoghesteot all ‘for items in which the “correct™ selection 
was made for the "correct" reasons. Conversely, the level 
of item stability was low for items answered incorrectly 
and lower still for items in which the selection did not 
involve the "correct" dimension. 

In view of the limitations in the other kinds of 
SQCpDOLtMLOreceSt Leliability, this evidence, of item 
Stabliaty 25 important in’ indicating a reasonably adequate 
degree of reliability for the experimental Poetry Test. 

Guessing is another source of measurement error 
which might be expected to reduce substantially the 
reliability of a test of this kind. The interview results, 
however, indicate a notable absence of Ntrue:, OL, puLely 
random, guessing. Only 38 per cent of the original item 


responses made by the ten interviewees were judged not to 
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involve the use of the "correct" dimension. Of this 38 per 
cent, approximately three-quarters of the responses involved 
use of a dimension other than the "correct" one, leaving 
only one-quarter which appeared to be based on random 
guessing. This indicates that only one-quarter of 38 per 
cent, Of cess than’ 10"=per = cent-of the total responses, were 
made on the basis of sheer chance. 

This low incidence of random guessing is in line 
with the relatively high level of stability reported in 
Previous pabagraphis. If a student's oOniginal responsesis 
based on random guessing, it seems less likely that after a 
lapse of several days he will be able accurately to recall 
this response than if it is based on a reasoning process. 
Thus, the high degree of accuracy of recall or item 
stability which was encountered appears to indicate a low 
incidence Of random guessing on the Poetry Test. 

A low incidence of random guessing was also indicated 
by comments volunteered by respondents during the interviews. 
One of the two interviewees receiving the lowest test 
ScokLes was So averse to guessing, and so loath to accept any 
of the alternatives provided that he marked in answers in an 
ineligible column on the IBM answer sheet as a gesture of 
DILOECSE. 

Tt is difficult to determine accurately the degree 
of similarity between reasoning carried out at the time of 
the test response and the reasoning done during thewsubse= 


quent interview, and there is a possibiimcye thar the 
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pressures of the one-to-one interview such as the desire to 
co-operate and the desire to appear reasonable produced some 
Spurious rationalization. All that can be reported here is 
that for the vast majority of selections plausible reasons 
were given readily and coherently. This in itself argues 
against spurious rationalization, and it seems entirely 
possible that apparently unreasoned or intuitive initial 
responses were actually made unconsciously and raised to a 


conscious »level as a result. of the interview questions: 


Weaknesses in Specific Items 

Tm addition to providing information om the relia— 
bility and validity of the Poetry Test as a whole, the 
interview results serve to bring to light serious 
deficiencies in certain items. Some of the more obvious 
of these defects are illustrated by items A-5, A-10, and 
Bo. 

In Item A-5, intended as a "Rhythm" item, and based 
Onetennyson's “Mariana”, the correct alternative was) Thar 
neldstne pear to the gable wall". Because mest on @the 
students responding to the test were unaware that "pear" 
denotes "pear tree", the correct answer was rejected by 
most students because it appeared meaningless. Consequently 
thesvalidity ofethis item is seriously in question. 

Ttem A-10 was meant to test students' awareness of 
ironic language. In this poem, "Peace and Goodwill" are 


referred to as a "glib pair" of hypocritical opportunists. 


al. siail betmmes. B- pnp 2ent ILA +A =a 
anousax afdbewsig, exotioo lau 70 paca 
davoze Aimesd, mh sid? el taezenos bar y 
utoviine emeee. th bas .anisest banasin a 
fataiel evtsiuaat 20.benoaertae iene eile: 


208 a 
p Ot Beater bas visu ioenooay oben vitesse pay i a 


becignavp. weivaesn’é sit lo dhumea ss, SE Lavet, es a 


534": * eee 
: ii a Soe BLASS 
7 Pe ah mare 7 i : or 
: : a 

—i@ten eld ab Bolsaaanir: pn ‘ibe org od “qo Et EBDB al = - 


Oe oe ele oat ae to yHibilev fm 


i> Tear ice. gnedl nitines 


; ‘wile 9% 
jl 
eae ‘= 


10 


iad OS ayted es luees. iS iv 


. 
( 
~ 

~ 
=. 
& 


an ovom 43 TO aK .Bmed! aisszeD at aotsael 


a 
o 
S 
&. 
> 
. 
- 
vr 
t 
healt 
© 
% 


enesh yt botat: aides ee Pe ae 


sal - ~  € j Sec = ve i 
Hes ax eng mass " ort 3 or > se annie y mm. ,an7A modt aL 7 


~ =) eel he 
oe Ln : ~ ry 19T AO 
Jatt” uw peiaantesia doers» eft “sasizak® «Ac sae ie, 
oan a) set 

ads So tear #40000 ."Liew alidap sid od =a8e 


oo = 


*xeen” seit Suaiens wiew tavs 4dt oF vathnoe | 
va hedoat es ase Tevdin Sae3 595 eat ee 
ie 5 ¥ 
¥yisnemenncl «4a rivacanen Sa Te ee qh $i ae : 
Hott aaup a ylaus irsa et seat city 20 ¥ 
a 

be whanau Vari teed 03 jasea eaw owt aE 
vrs eh ~~ ‘ nL ee PB 7 cae 
ein. ~ETiuEdon bine éoba't .a307] eins ix i) 


a A ek : * 4 a 
‘Siatedea jainiswege isgis frase aia Io “alsg difo* | e 
- _ ee, a - i -  @te takes 


2 Or 


What was intended to be the most tempting Cis iGacto rm awGnoed 
and Deceit", best suited the immediate context if not taken 
ironically. However, most respondents, apparently paying 
little heed to the context, noted the word "Christmas" in 
the first line of the poem and in a stock-response manner 
selected @the Micorrect “answen, "Peace and Goodwill". for 

tiem woong “reasons ; thus! frustrating the intent of the 
question. 

Another obvious defect is indicated by Item B-9. [In 
this poem, the word kiss is used several times, first 
literally “and then metaphorically, to suggest a certain kind 
Of look in a boy's eyes. The question required the 
respondent to choose among the correct answer "kiss" 
fap lyemetaphorical),, “look! ~too literal), “love” (meta= 
PuOmicae Dut wWanal ye ands tare Sunsuicably metaphorical) ™ 
Most respondents, seeing the word "kiss" twice previously in 
the poem, selected the "correct" answer purely because of 
repetition. Thus the attempt to measure sensitivity to 
metaphoric language was thwarted. 

Like Item B-9 Item A-15, based on Frost's poem, 
ENOthingmeGoldeG@an Stay), (failed Although i tewes primarily 
intended to measure students’ awareness of something 
relatively subtle--in this case the connotative value of a 
word in a certain context--interview results indicate that 
for most respondents the selection was made by applying a 
simple formula, in this case direct word Peper it lone Colds, 


the original, was apparently selected not because it has 
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greater richness and precision of suggestive meaning than 
the distractors but simply because the word "gold" had 
appeared earlier in the poem. Here again failure on the 
investigator's part to anticipate the gap between the intent 
of an item and the way it would in fact be answered resulted 
in low validity and extremely low discriminating power 
(biserial correlation coefficients of 0.06 for Grade xX 
students and'0.26 for ‘Grade XII students). 

A more subtle defect is illustrated by Item A-4, 
which was intended primarily to measure students' responsive- 
ness to the sensory values of poetic language. In this item, 
based on Ransom's poem "Blue Girls", the original phrase, 
"all her perfections tarnished", is set in an immediate 
context which attempts to convey by means of highly concrete 
language ("Clear eyes fallen from blue") a sense of the 
horror of the physical decay of a beautiful woman. The 
distractors either failed to convey this sense ("ended," 
"forgotten"), or conveyed it in a weakened, non-sensuous, 
manner ("ruined"). From the interviews it appears that most 
of the students who selected the "correct" answer, 
"tarnished", made their selection mainly on the basis of 
sound. Because in this case the meaning of the word is 
inseparably linked with its sound the item is still judged 
to be reasonably valid. Nevertheless it is doubtful that 
it was successful to any significant degree in achieving 
its primary purpose, that of measuring response to a particu- 


lar use of sensuous language. 
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Item B-12 serves as a final example of the useful- 
ness of the interviews in either pointing out or explaining 
specific weaknesses in individual items. This item, based 
on Sandburg's poem "Jazz Fantasia", attempted to measure 
students' ability to respond to a mixture of the evocative 
qualities and the sound values of a word, with a heavy 
emphasis on the latter. Item analysis data showed the item 
LOpPerunexpectedilysdirficult= (a difficulty index of 0308) for 
Grade X and 0.28 for Grade XII) and to have relatively low 
discriminating power (a biserial correlation coefficient of 
Ot52206 Gradenxeandsot 23s peamlower. figure, “foreGradee<a 19). 
finterviewrresults indicate’ thatethetdifficuity results mainly 
BROMMONeLOL O thevdistractors, = «bang. ) i beingmeithereas 
effective as or more effective than the original, "batter", 
an cermsforithertotal contexteandmthe tauthor 's®intent ios 
the four interviewees who made very high scores on the 
Poetry Test, three stoutly maintained and plausibiy argued 
Eaten bange -LSesuperior .to Vbhatter"™] WEhis suggesessenacrone 
dicricumtry Gin. thekconstruction of *this*kind "OL teste=is¥thiac 
OnvocGasion “a variant Might be interpreted aS superior to 


the original, even with a poem of widely recognized worth. 
INTERVIEW RESULTS AND STUDENT RESPONSE 


The purpose of the follow-up interviews is two-fold: 
to provide additional information about the experimental 
Poetry Test and to supplement the knowledge about students' 


response to poetic language gained indirectly through 
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statistical analyses of test results by direct questioning 
of respondents about their thought processes while responding 
totthe Various test items. The first of these purposes was 
considered in the previous section. The following section 
deals with information provided by the interviews concerning 
the way high school students respond to poetic language. 
Common Characteristics ain jStudent 

Response to Poetic Language 

The observations made in this section result from an 
analysis of approximately eight hours of recorded interviews 
with ten students. Because most of these comments relate 
eathermedinectly jor indirectly ctoe rationalization"; it tseems 
useful at this point to re-define this term and to examine 
the processes it denotes as related to the present study. 

In its general use "rationalization" usually means 
thewacteod LexpVeining iorecgiving reasons “for ta tgiven action 
OGedecision. For the purposesiio£ ‘this study “degree: of 
Gataonalrzation means ithewextentwtoywhich argiven factor 
selection can be recalled, brought to a conscious level, 
and coherently explained, as determined by analysis of 
MNECGV Lew restless ces s OUa Mit yor erat ronalizationwaaenores 
(aje the idegree of similarity between reasons actual ly 
underlying. the original selection, as determined by inter- 
view results, and the reasons given during a subsequent 
interview, cand «(b)p the textentto wwhich thas wom Guncietcomplex 
of reasons approximates that which could be expected from a 


highly qualified reader of poetry. It is obviously more 
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difficult to measure and reach valid generalizations about 
"quality of rationalization" than about "degree of rationali- 
Zoe lola 

The following six observations concerning pupil 
response to poetic language are derived from the interview 
resuits: 

1. The persons interviewed generally showed a much 
higher degree of rationalization than had been expected. In 
the main, students not only were able to recall what 
decision they had actually made but were readily able to 
give reasons for their selections (see Table LII). It was 
expected that with the high scorers the degree of rationali- 
zation would be considerably higher than with the low 
scorers. The actual difference, however, was only slightly 
Pimvavaur em lesen hescOlLe lS nmeusPecliapswtiis 1separbially, 
explained by the likelihood that a person attacking a 
complex problem in an overly simple fashion will find it 
easier to talk about his mental operations than a person 
whose mental operations, although perhaps more relevant to 
the problem at hand, are more complex. 

Dee Thescuakityeocmrational~zation ,mdasacetImedsanove, 
was, like the degree of rationalization, generally higher 
than expected. To the extent that the term denotes 
Nattacking the question from the point of view intended by 
the question-maker", it is possible to measure quaditynot 
rationalization by determining the extent to which inter- 


viewees reported using "correct" reasoning. As reported in 
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the previous section (see Table KGVie) py Pcne correct! 
approach dimension was used for approximately 70 per cent of 
all item responses about which interviewees were questioned. 
To Chevextentechate quality sor rationalization’: 
denotes*the ability tovreconstruct’ and report) with accuracy 
the actual thought processes underlying the original 
selection, it remains a construct difficult to assess with 
anyedaecree "of accuracy. To" thew extent’ that an “anturtive 
or unconscious level of reasoning underlies the original 
Selecciones 35 NOC possible “to compare an Original actseor 
selection with a subsequent recollected version. In other 
words, it is not possible to determine accurately to what 
extent an explanation for the original selection, valid as 


it may have been in terms of "correct dimension", was an 
accurate reconstruction of an original thought process. 
Thatemany yor the soriginal,’ acts*of selection were” ofan 
intuitive nature appeared very clearly during the inter- 
views. In many instances students who were at first unable 
to give a reason for their selection were subsequently able 
topdowsoras a result of S°Minimal” amount of probing and a 
great deal of waiting on the part of the investigator. In 
Bpitesoten Lack Gor direct@cvidence au scems™likely, 
particularly in view of the high item stability indicated 
by the interviews and the high degree of correspondence 
between the "correctness" of the original selecting and 


the "correctness" of the subsequent explaining, that most 


of the rationalization by the interviewees was of a high 
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"quality". This "high quality" can be conceived both in 
terms of conformity with the reasoning processes which the 
test items were intended to produce and in terms either of 
the recall of conscious thought processes or of the recon- 
struction at the conscious level of originally unconscious 
thought processes. 

Tigwas expeetedmrhatttierqualaty Of trationalazatien 
would ebeesubstantiallyshigher forpthechigh scorers thanefor 
low scorers among the students interviewed. This expecta- 
tion appears to be borne out by interview results. 

Jaume LNEeGesappearse coe heRconsiderablesgvaritery inetne 
ways different students approached an item. Generally, the 
low scorers seem to have approached every poem as if it were 
a piece of exposition, forcing "common sense" meaning into 
all items regardless of appropriateness to the context. 
Other students, apparently determined to find various kinds 
of patterns which they had been taught to look for in 
poetry, formed patterns where none existed. Still others, 

a smaller group, scorned "meaning", and, as it was typically 
expressed, "went by the way it sounds." 

Tnecontrast, atheshigwescorerssappearsto have 
approached each poem and each item on its own terms, ready 
to match part to whole in a number of different ways and 
ready to use a wide variety of clues afforded by the context. 

Ame lAsmwaserepor tecmecriier ac hienegappeat seinem cnc 
interviews more evidence of the application of a faulty 


formula than of true, or random, guessing. Even when the 
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presence of guessing is indicated it usually involves 
elimination of one or two of the least likely distractors 
by some reasoning activity and then guessing among those 
remaining: a process not uncommon in the answering of 
multiple-choice items. 

Deeg As Tima mummcontext Sp pringiplencppears  »toube 
operating with the students interviewed. High scorers and 
low scorers alike tended to use only the immediate context 
of the word or phrase in question and to use a bare minimum 
Otaciues, fromthe larger: context of the whole poem. Both 
high and low scorers seemed to be largely unaware of the 
total meaning of most of the poems. (It might be inter- 
jected here that this is not considered a serious weakness 
of the Poetry Test because of its focus on response to the 
fanguagde: Of spoctry erathers than on the meanings of whole 
poems. ) 

The difference between high and low scorers in their 
USemOmECOnLe xomappeat se COmDe BL DatLslagheSCOLeES. CendedmtOmuse 
as much and only as much context as was needed in "solving 
the puzzle". dn the few =iltemse such as A-1l2 and) B=l3 where 
knowledce of the total context wes required the high scorers 
were highly aware of the total meaning of the poem. The 
low scorers, on the other hand, tended to use too little 
context where much was needed and too much where little was 


needed. This matter will be discussed in the following 


section. 
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6. In general the students interviewed showed little 
knowledge of the terminology of prosody. High scorers and 
low scorers alike were rarely able to name the metre in 
which a poem is written or to identify types of images. Not 
oneghad heard of half rhyme, or slant rhyme, and the terms 
"alliteration" and "onomatapoeia" were known to only two of 
the students interviewed. Most of the interviewees, 
including those who demonstrated a high level of confidence 
and skill in applying knowledge of the operation of poetic 
language, reported that they had studied poetic nomenclature 
in school but that they had found it "useless and boring" 
and that little of it had been remembered. 

Surprisingly, about half of the students who were 
readily able to match the part to the whole according to a 
metrical pattern were unable even to count the number of 
Stresses in a line. The interview results, therefore, 
suggest that a high degree of awareness of various types of 
patterns in poetic language can exist atua relatively 


unconscious level. 


Comparison of High and Low Scorers 

The students interviewed were selected so as to 
obtain a representative cross-section of very high scorers, 
average scorers, and below average scorers on the Poetry 
Test. (Very low scorers were omitted because Lt Wasetekt 
that little useful information would be provided by 


students obtaining scores which are less than Louse, #asen, 
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which are at the chance level.) It therefore appeared 
worthwhile to use interview results in constructing two 
composite profiles, one based on the responses of three 
highest scorers and one based on those of the three lowest 
scorers among the interviewees. High and low scorers are 


characterizedgin capsule form ini Table Diil. 


Characteristics of high scorers. The composite 
PLOcilemrepresenting thes "good peetryereader' gs baseduon 
interviews with two Grade XII students whose score of 14 
placed them at the 99th percentile for the total group and 
with one Grade X student whose score of 10 placed her at 
the 98th percentile for the Grade X group. These three 
interviews, together lasting slightly more than two hours, 
were examined in detail. 

From this examination the following impressions and 
observations emerged: 

1. The high scorer tended to need all of the time 
which was allotted for the test. Sample comments: "I would 
have: liked more time;to go over the questionss; “L had 
barely senoughitime."™ The highmscorer@tended co 7espond 
slowly and carefully to the poems comprising the items, 
takinge'a lotsot time" with the difficult, ones and lingering 
over words. and expressions. 

2. The high scorer tended to regard the test as 
fairly difficult on the whole but with individual items 


varying in degree of difficulty. Although aljow Jereneley velepanc) Tepe 
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the test items were placed in an order of increasing diffi- 
culty the high scorer tended to find the items becoming 
easier as he progressed. Sample comment: "At first it was 
impossible, but it got easier as I went along." In general, 
though, the high scorer's perception of the difficulty of 
individual items tended to concur with the item difficulty 
data reported in chapter “IV. 

3. The high scorer tended ‘to find the test highly 
interesting. Sample comments: "It was interesting--sort 
OL va game 3" 1 “could have cone on’ for ‘another nour) "1 
Gusiixed 1tat finst then © became. involved, and 1 was 
really fascinating." 

i Lhe high scorer tended "to be highly tlexipie 
yet systematic in attacking the items. He looked first for 
obvious patterns and clues in the immediate context and if 
this procedure /failed for progressively more subtle types of 
clues. He tended to re-read the poem or relevant portion of 
the poem and the alternatives several times, alternating 
between the two strategies. He realized that several types 
of skill were being measured and was responsive to sound and 
suggestion and pattern in words and expressions as well as to 
their "meaning". He knew with each item what was being 
measured (the figures in Table XLVII show that the three 
high-scorers AVeEraAgea  >uOULsOrmlO 1m this ecespecl)r 

It is interesting to note in this connection what 


Kneller says of the creative man in The Art and Science of 
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Creativity. According to Kneller, creativity is charac- 
terazedeby,mental flexibility, intensity) of sinterest} sand 
variety of approach. It involves the ability to respond to 
things as they are, a tolerance for ambiguity, and a 
reluctance to force interpretations. This description of 
creativity applies very well in the present study to the 
mental stance of the high scorer in approaching an item. 
It accords with the view that the reading of poetry is a 
highiveactive, “creative” activity vandtofLfersestrong 
evidence that the experimental test is successful in 
identifying good poetry readers. 

5. The high scorer was able to make inferences 
aboutethe totalsmeaning of poems, butstended, above “all 
else, to be distinguished by an unusually high sensitivity 
to, the sound andesuggestion of! words *and ‘toethe tone ‘of 
individual passages. | 

6. The high scorer tended to be efficient in his 
use somecOntext sin. solving" tan sitemmsthe used onby whatiwas 
mecessaryyand relevant, and edidenot rallow irrelevantwdistrac- 
tors to affect his selection. When, however, a comprehensive 
Context is required, as in Item B-13, he mastered thas 
CONntext, 

7.) The high scoren, although not: necessarily va 


reader of poetry, tended either to read a great deal at 


teneller, The Art and Science of Creativity (New 
York: Holt, Rinehart, 1965) p 164. 
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present or to have read a great deal in the past. He also 
tended to be a writer of poetry, although not regarding him- 
Serr faSeproLacient, and was likely to view the handling of 
words as "frustrating". The characteristic answer to 

“Have you written any poetry?" was "Some, but I'm Beau lye 
qoodvat vu. 

8. The high scorer tended to be curious about his 
own test performance and the original versions of the 
Varbious poemsws He tended to talk -about the test witheother 
Stucenueseand@evermetor try, tordiscover the ssourcesof certain 
items. 

9. The high scorer tended to make unsolicited 
affective comments on the various poems, such as: "I 
really liked this one"; "This was a cute one"; "I just 
eouldnsteseesthisv one"; lheswhole things sort of sick. 

10. The high scorer tended to have an unfavourable 
view of the way in which poetry is taught. Sample comments: 
mIPaGiwtw@l ikerthnee way it's being taught. Too manyeset 
poems; » Teachersecon’t like teaching 1. "3; “Have Isenjoyed 


Giempocltieyvmmiuveriad) ineschoobes Now much. 


Gharacteristics Of lowescorers., Tie Lollowing 
comments are based on three interviews, two with Grade X 
students whose score was 5 out of 16 and one with a Grade 
XII student whose score was 6 out of 16. These scores are 
slightly below thess0th pencentile,. 


1. The low scorer had more than enough time to 
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complete the test. He reported needing little more than 
half the time provided. His response to the language of 
the poem tended to be rapid and superficial, and he showed 
little desire to re-read poems and linger over words and 
expressions. 

2. The low scorer saw the test as between "fairly 
easy=-and "medium" in difficulty. He was much less aware 
Oigcin S-Lelnces, is) ttemidifficulty ethan waco acne nigh scorers 

3. For the low scorer the test ranged from "kind 
Of Dening, or tairly ‘enjoyable.] — Sample comment:) "i 
didn't "like a lot of them because I couldn't understand 
them." 

4. Whereas his high-scoring counterpart was flexi- 
ble, the low scorer. tended to be rigid in his approach to 
the various items. While the high scorer approached the 
poems on theirjown terms, receptive to the sound, suggestion, 
Hone tpacterns, the low scorer tended to read them as he would 
a piece of non-poetic writing, looking only for referential 
meaning. In his approach the denotative, or “everyday. 
meaning tended to displace "poetic" kinds of meaning such 
as connotation and sound values approach. 

This “displacement” Concept is Supported by the 
data presented in Table LIV which gives a summary of the 
interview responses by high and low scorers according to 
subtests. This summary clearly indicates that, while for 
the high scorers the "dimension score", an index son tne 


respondent's ability to approach an item using the LCOULGLEG In 
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dimension, is highly consistent among the four subtests, 
with the low scorers it is roughly three times as hagh ton 
Subtest One ("Thought") as it is for the other three sub- 
Cesta. 

Subtest One ("Thought") measures a type of compre- 
hension which is to a fairly high degree common to both 
"everyday" and "poetic" language, while Subtests Twooe Taree, 
and Four ("Suggestion"”, “Sound” ?;"and Rhythm") measure 
skills more peculiar to poetry. The discrepancy between 
“dimension scores" for Subtest One and "dimension scores" 
for the other subtests among low scorers may be due to the 
Pace tliat the “low "Scorer “"s"basical ly" unable co =copel with 
poetic language. While he may have an adequate conception 
of the workings of non-poetic language, the low scorer 
appears to be characterized by an inadequate conception of 
the operation @f poetic language. Here, apparently, is *the 
chief difference between high and low scorers. 

The only concession the low scorer appeared to make 
to the fact that he was reading poetry was an attempt to 
apply certain simple formulas having to do with rhyme, 
alliteration, word repetition and line length which he 
seemed to regard as essential to poetry. 

The low scorer generally failed to recognize that 
several different skills were being measured and tended to 
use the same amount of context, usually in a superficial 
manner, for each item. The low scorer appeared unable to 


distinguish between what is relevant and what USenoOt. His 
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method of attacking an item was to read the poem quickly and 
if possible select the alternative best fitting the referen- 
tial meaning. When this approach failed and the "meaning" 
escaped him, he either selected "the one which sounded best" 
or simply guessed. Sample comments: "I chose whatever I 
feltrepirted——Tareal loaused meaning "7 isl shadenosspeciaieplan 
(@he aoteaies Ttusedwimeaningr first pechen tsound'is0"Ltused the 
same approach for all. I used meaning." The low scorer 
tended to have a somewhat limited notion of the various ways 
in which a poem "means". 

5. The low scorer tended not to be a habitual 
reader. He reported reading "Some books", "some novels and 
short stories". He reported rarely reading or writing 
poetry. artlers “Lroothboringe>: Peecoo tdeen 

6 nueltheslowsasconrermiiarled jtoimakesvoluntany absec— 
tive comments about the poems comprising the items. When 
pressed, he tended to report disliking most of these poems 
findimmoqeschemyebor ings: 

Jee Theslowsscores;, Likesthe hightscorern;eroundstaule 
Withethe way poetry is taughtuin school’ but “Sew thesmain 
cause of his dislike in the fact that poetry is intrinsi- 


Cal ivetboringumand ilistupud lym ve. % incomprenensible. 


Possible Diagnostic Value of the Interviews 
BOs SL OLeE Ye tag 0s A 

In addition to providing general information about 
the way high school students respond to poetic language and 


to pointing up differences between the way superior and 
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inferior poetry readers approach a poem, the follow-up 
interviews provide some indication that similar kinds of 
interviews could be valuable as a device for identifying 

and explaining specific areas of weakness either with 
individual students or with individual instructional 
programmes. As an example, one of the students who was 
interviewed failed to respond Correctly to any of the “metre” 
items. The follow-up interview showed that he was only 
dimly aware of what was being measured, and had no idea of 
thegconcept of metrical language. Thus), this kind of inter— 
view promises to provide valuable information in planning 
teaching programmes for specific students and groups of 
students. 

In the light of the results reported in the present 
ehapter, such programmes would well be based on tne vassunp= 
tion that much of the students' failure to understand and 
hence enjoy poetry results from ignorance of the way poetic 
language conveys meaning. These programmes would be 
directed to teaching students how to approach poetic 
language and might focus on such topics as "How metre con- 
tributes to meaning in poetry" and "The place of the sound 
of words in conveying meaning." There is nothing novel 
about such suggestions, but the Poetry Test and interview 
Besuilics strongly indicate the need stor their fuller somple= 


mentation in many English classrooms. 
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CONCLUDING REMARKS AND SUMMARY 


Finally, it might again be noted that while the 
results reported in the present chapter appear interesting 
and promise to provide direction for further investigation, 
they are based on a very limited number of subjects, and 
hence must be viewed as suggestive rather than conclusive. 
However, certain generalizations can be made on the basis 
of the interview results: 

1. Generally, there is a high degree of correspond- 
ence between correctness of response on the Poetry Test and 
correctness of "dimension" as reported in the interviews. 
This close correspondence, which is considerably higher for 
high scorers than for low scorers, provides additional 
evidence regarding the test's validity. 

2. Generally, there is a high degree of correspond- 
ence between correctness of response on the Poetry Test and 
the correct recall of the original selection as reported in 
thesanterviews. This correspondence is higher for correct) 
responses than "incorrect" responses, and higher for 
responses made using the “correct” dimension chan for 
NGorrece™ responses. Lt andicates a high level or item 
stability and hence provides one kind of evidence for the 
Pecmcwlel Labalucy . 

3. The interview procedure as employed in this 
study proved to be a useful adjunct to the experimental 


tectaineproviding directacvidence regarding weaknesses in 
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specific items. The reasons for these weaknesses, which 
could only be inferred from examination of item analysis 
data, were in many cases explained by the interviews. In 
this way interviews of this nature can be used in improving 
a test or in more accurately interpreting test results. 

4. Generally the interview results indicated both 
avhigh degree of rationalization “and: a high"quality of 
rationalization (see page 265). However, while the degree 
of rationalization was approximately equal for the high and 
low scorers, the quality of rationalization was considerably 
higher for the high scorers. 

5. Different students tended to exhibit different 
strategies in approaching test items. Low scorers tended 
to use the same approach for each item while high scorers 
tended to vary their approach in accordance with the nature 
of the item. Some students appeared to attempt to use a 
logical reasoning process throughout, regardless of the kind 
Otmiten, sapproachingmpoerice language as they wouldereseren— 
tial language, while others simply "went by their feelings", 
either initially or after the unsuccessful application of an 
inappropriate formula. 

6. foo hightand How sconerss alike ra "“minimum- 
context" principle appeared to be operating. The difference 
is that high scorers used only as much context as was 
necessary to "solve" the item, often failing to understand 
the meaning of the whole poem, while low scorers, although 


using the same amount of context as high scorers overall, 
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tended to use too little for some items and too much for 
others. 

7. Generally, the students interviewed displayed a 
minimal knowledge of poetic terminology. 

oe.) ihe high) scorers, ine general, tended ito readmthe 
poems slowly and intensively and to see the test as diffi- 
Culi@bul interesting. They were both systemacic and 
flexible in their approach to the items and showed a high 
degree of sensitivity to the sound and suggestive qualities 
of individual words and phrases. They made efficient use of 
context. They reported doing a substantial amount of 
reading and often made unsolicited affective comments about 
the poems comprising the items. 

9. The low scorers, in general, read the poems 
quickly and saw the test as fairly easy and quite uninterest- 
ing. “They tended to approach each item in the same way and 
to read the poems as if written in strictly referential 
language with superimposed metre and rhyme. They failed to 
see that the test was attempting to measure separate skills. 
They reported not doing much reading, and rarely made 
affective comments about the poems comprising the items. 

10. With some of the students interviewed, a total 
inability to cope with certain kinds of items became 
readily apparent. This indicates that interviews such as 


those used in the present study have considerable diagnostic 


value. 
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CHAPTER VI 


SUMMARY, CONCLUSIONS, AND IMPLICATIONS 
SUMMARY OF THE RESEARCH 


Mes present studvyeattemptcdsto investigate. (a)mtne 
response of high school students to poetic language and (b) 
the usefulness of an investigatory procedure consisting 
primarily of an experimental poetry test which was developed 
in order to examine this response. 

The Poetry Test attempted to measure student response 
using four inter-related yet reasonably discrete categories 
(Thought, suggestion, Sound, and Rhythm). “in essence atic 
tect. employed. the Vvariant, version seechnieue | Ineecach 
item a portion of an original poem was deleted so as to 
require the respondent to select the original from four 
alternatives by using the context of the whole poem in any 
Wav mice ScoWelit wlDe a Goya hinpeelten, se cOrme cal eye liowmmeche 
ObMtne Or CGindilamighnt, be -distertedg in Vvarvouse Way sean «tne 
threcedistractorsa so, aS, tO, lal! tOs tits the mectrmi Calmpabeenn 
Ote the, CONtext. 

Two forms of the Poetry Test, consisting of 46 items 
each (four in each category) were administered to 191 Grade 
X and XII students in North Vancouver, British Columbia, 
together with a standardized reading test. Follow-up 
interviews based on Poetry Test responses were held with a 
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representative sub-sample of 10 students. 

Item analysis was conducted with the Poetry Test 
results in order to determine the difficulty level and 
discriminating power of each item and to provide detailed 
information about response patterns among the four alter- 
natives in each item. Intercorrelations among the four 
subtests and between the Poetry Test and Reading Test were 
obtained to determine possible patterns of correspondence. 
Two-way analyses of variance were carried out to determine 
the degree of relationship between grade level, sex, and 
reading level, and performance on the Poetry Test. 
Principal components analysis was also carried out in an 
attempt to identify possible factors in response to poetic 
Tanguage. 

The ten recorded interviews were analyzed in order 
to obtain information to supplement the results of the 
statistical analyses. The interviews focused on the reasons 
behind student choices within the various items. Interview 
Fesules were examined in an attempt to identify certain 


common characteristics in student responses to poetic 


language and to characterize “good" and "poor" poetry 


readers. 


SUMMARY OF THE MAIN FINDINGS 


1. The evidence presented indicated that the 
procedure used in the study was a useful means of investi- 


gating student response to poetic language. The experimental 
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poetry test, although difficult to construct, was generally 
found to be sufficiently reliable and valid for the kind of 
research conducted in the present investigation, and proved 
capable of providing a wide range of information about the 
way high school students read poetry. The procedure 
developed for the interviews also proved satisfactory in 
eliciting information about a student's thought processes 
as he reads a poemsandvabout the Poetry Tést! itself. 

2. The Poetry Test was on ce adssriculLtesideiror 
thessemplettested land was generally tooldiréicuit for the 
Grade X8Studentsmmeeingterms ofgdifiiculeyiat wastmuchemone 
suitable for the Grade XII students. Also, the Poetry 
Test, in terms of mean item discriminating level, was more 
reliable for the Grade XII than for the Grade X students. 

3. Low positive correlations were found between 
performance on each of the four subtests and between per- 
formance on items within each of the subtests. This indi- 
cated that what was being measured is a complex of partially 
discrete yet interconnected skills. 

Aveethe threetfactors identi fredrshowed snotelear 
relationship to the performance on the subtests. The 
factors appeared to relate to "analytical" (as opposed to 
"instinctive") abilities rather than to skills in response 
to traditionally "poetic" uses of language such as metre 
and imagery. This finding, together with the interview 


results, provides further evidence of the Gomp bexatry gon 


response to poetic language. 
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32» The slow: positives correlation of Poetry Test 
performance with Reading Test performance indicated that 
whatgthe Poetry, Test measures is to.a large degree different 
from what is measured by standardized reading tests. 

6. There was a much closer relationship between 
Grade Level and Poetry Test performance than between Reading 
Level and Poetry Test performance. Virtually no connection 
was found between sex and Poetry Test performance. 

7. The interview results revealed that both the 
poegree, and voudlity of meationali zation ,, as ceLinedson 
page 249 were unexpectedly high. Students, when pressed, 
were generally able to give reasons for their various 
choices with a good deal of clarity and sense. While the 
pOegteerOn cationali zations) Was) approximately, the usamc ator 
the high and low scorers interviewed, the "quality of 
rationalization" was considerably higher for the high 
scorers. 

8. The interview results revealed that in addition 
tosashigh “degree” and "quality" ot rationalazetion, 
students answering the Poetry Test appeared to share 
Certain otner characteristics, such as a reluctance Lo 
guess, a propensity to use a minimal amount of context, 
and little knowledge of poetic terminology. However, these 
results also indicate that the response of high scorers 
differed from that of low scorers in a number of ways. As 
opposed to low scorers, high scorers read the poems com- 


prising the items more slowly and intensively; they tended 
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LOmvViewathe test as more udifiacult, but. less interesting; 
they were more systematic yet more flexible in their 
approach to items; they made more efficient use of context, 
concentrating only on useful clues; they had read a great 
deal of imaginative literature; and they voluntarily made 
affective comments about the poems used for the items. 
CONCLUSTONS RELATING TO THE 
INVESTIGATORY PROCEDURE 

i ~thevsuccess Of vapcest suchas the Peetry Test, 
designed primarily for research purposes, depends upon the 
degree to which some meaningful and important psychological 
variable has been identified and quantified. In the present 
study, this variable is “skill in responding to poetic 
language". In the light of what is known about the 
complexity of language in general and of poetic language in 
Daguuci lam manish cone li ghteoreune explora loOLy eWaLuUT emo. 
ChicmeSoEUCy ma tawas CONC lUudeccetnate Lies Proctiny, Testawas 
reasonably successful in identifying and quantifying the 
Varlable under investigation. |§ The testing procedure 
appeared sufficiently valid and reliable and sufficiently 
productive of useful information about student response to 
warrant further application. Perhaps a modified form in 
which only. one aspect of poetic language is examined with 
agdreacer degree of precision than was possible in the 
present study could be developed. 


2. The "variant version" approach used in the 
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Poetry Test in conjunction with the factor theory and the 
operations of factor analysis promises to furnish a 
practicable means of testing whether a test or test item 
which appears to measure a certain trait or component does 
SOviIne CenmssoOL underlying ’constructs. Factor analysis, for 
example, can establish empirically whether hypothesized 
aspects of "response to poetic language" actually emerge in 
practice and how well they are measured by a particular 
testing procedure on a particular test. 

3. SelNewpresentsinvesrigarory procedure consisting 
of an objective test supplemented by follow-up interviews 
based on test responses promises to be useful in examining 
a student's thought processes as he reads a poem. The 
test and interview each provide information which can not 
be provided by the other and which is necessary in forming 
adequate interpretations and conclusions. The interview 
provides more directly, but less systematically and 
ObfFechively, 1MnfLormation Woche thes test providessoml, 
indirectly, but more systematically and objectively. 
Variations of the present test-interview combination appear 
promising for future investigation of student response to 
literature. 

4, The information provided by the test and) inter; 
views promises to be of diagnostic value in pinpointing 
weaknesses not only in individual students but also in 
teaching programmes. For example, a student who knows the 


terminology of prosody but fails to understand the operation 
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of metre could be easily identified. 

». The interview results indicate that the present 
investigatory procedure has potential value as a teaching 
as well as a testing device. The reactions of the students 
interviewed appeared to support the teaching use of 
“variant versions" advocated by such authorities as Murphy .* 
It seems that the initial matching process demanded by the 
test secured the student's involvement, encouraging him to 
share in “creating” a poem. His subsequent discussion, 
defense, and perhaps alteration of"= the” original selection 
appeared to constitute an effective learning situation. 

CONCLUSIONS RELATING TO STUDENT RESPONSE 
TO POETIC LANGUAGE 

1. There is evidence in this study, especially in 
the low correlation between Reading Test results and Poetry 
Test results, that there is a substantial difference between 
response to poetic language and response to "non-poetic", or 
discursive language. In a sense the successful reading of 
poetry demands a specialized reading skill, and the results 
of the interviews indicate that the main reason for failing 
to respond adequately to poetic language is the tendency 
of the "poor reader" to approach poetic language as ie Abe 
were merely an embellished form of discursive language (see 


the discussion of the Popean versus the Coleridgean view in 


leeraldine Murphy, pune sscudy Ofelia ceralLure pine tne 
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Chapter II). 

If, as this study indicates, failure to derive 
meaning from poetry and hence failure to enjoy it stems 
mainly from ignorance about how poetic language operates 
and about the nature of the particular kind of meaning it 
attempts to communicate, the implication for the teacher 
Ofpiaveraturestsicicarseshis chiek task is tosteachehis 
students how to read poetic language. 

2.weMore partucularlyvaiukne study andieatesmrnatwan 
intensive, text-centred approach is necessary to the full 
understanding and appreciation of poetry, and that this 
approach, if employed imaginatively and with discretion, 
need not induce strain or boredom in students. The "good 
readers", as characterized in the analysis of interview 
results, showed a tendency to linger over words and phrases 
in an deceptively passive state, willing, as Virginia 
Weolt puts if, seoubesthekwriterts jaccompl ice sem teshould, be 
noted that this conclusion regarding the importance of close 
reading in no way precludes other useful approaches to an 
imaginative or literary work, including those often termed 
BaxvtrnisiGi. plneepresenteatest, by ENekverygnature ofgtie 
matching technique employed both demanded close attention 
to the individual words and expressions of a poem and, for 
some respondents indicated that this close study could be 
interesting and perhaps even exciting. 

3... The relatively low-positive correlations among 


the four sets of subtest scores indicate that skiciis in 
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response to poetic language consists of skills which are, 

to a considerable degree, separate. Thus to some extent 
these skills can, with due awareness of their inter- 
dependence, be considered as separate for teaching purposes. 

4. The generally low correlation between Reading 
Test performance and Poetry Test performance suggests that 
perhaps standardized reading tests such as the Nelson-Denny 
Testeraitesufticiently to take into account the suggestive 
and sound values of words: values which appear most 
consistentiy ingpoeticeilanguageshelTheuresnits*osithicmsctudy 
suggest that standardized reading tests, in measuring 
student's understanding of word meanings, need to concern 
themselves with a wider range of meaning than they do at 
Present. 

5. The detailed examination of item responses 
presented in Chapter IV reveals that the intent of many 
items, all of which had been examined by a committee of 
judges well versed in the theory and teaching of poetry, 
Pavledeto coincide with response patterns.) Thistdailiicrence 
between the way a skilled poetry reader responds to an item 
and the response of a large number of the students examined 
in this study underscores the need for further studies 
which focus on the way students actually respond to poetic 
language. 

64 The’ increase: ofsGradesXid Poetry Testrmeanssover 
Grade X Poetry Test means, especially for Forms, ethemymore 


reliable of the two test forms, was larger than the 
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corresponding increase in Reading Test means. This suggests 
that during the high school years there is a substantial 
gain in students' awareness of the nuances of language which 
are found in their most concentrated form in poetry. To 
what extent this gain is due to effective poetry teaching 
and to what extent it is due to increased experience with 
language in general and to other factors is a matter for 
further study. 

7. Generally, the interview results revealed that 
high scorers and low scorers alike found fault with the way 
poetry is currently being taught in the schools. Beyond 
OLreringetlealLew,. that. poetry 1S.) boringiy es. dry..,eand 
"jrrelevant", however, the students interviewed were 
generally at a loss to account for this negative attitude. 
Although it is easy to speculate on this matter, the present 
eludvaciUsnOteatltenpiedireck ly tOvexamane studenu arereudes 
toward poetry and the teaching of poetry. This, also, is 


Clean lVedsiatterwloretux thers research. 
IMPLICATIONS FOR THE TEACHING OF POETRY 


Although the ultimate, purposesof the precentastudy 
is to improve the teaching of poetry by providing teachers 
with information about students' response to poetic 
language, the immediate objective is to assist in the 
investigation of poetic response by developing a reasonably 
valid and useful measuring instrument for future experi- 


mentation. By exploring a particular investigatory 
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procedure the study hopes to encourage the development of 
Similar procedures. 

Nevertheless, it is possible to derive from some of 
the study findings certain implications for the teaching of 
poetry and for the evaluation of "poetic understanding". 
Some of the more obvious of these implications, most of 
which have been touched on in’ previous'sections, are 
presented in summary form: 

1. The generally low scores on the Poetry Test, 
che=ract™ that* the” "Thought "Subtest scores are*higner tor 
both®grades, than* those’ of the other’ three subtests, and a 
number of comments by the ten students interviewed all 
suggest a widespread need for teaching students how to 
approach poetic language. This need, though difficult to 
demonstrate conclusively, is generally confirmed by the 
Emoaings= ofthe present study: 

2. While the interview results suggest that there 
exists a fairly prevalent negative attitude, even among 
the highest scorers, toward the way in which poetry is 
taught, these results also suggest a higher than expected 
fevyed@oLreinteresre in poetry aitseliamongs youngepeopler 
AGainyeche Amplication. isithat’ thereth cValneed ston emore 
imaginative means for securing student involvement while 
studying Bee ery and for developing in students more’ skill 
in approaching poetic language. 

3. The considerable differences between the perform- 


ances of the two grade levels, especially with regard to 
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Factor B (see Table XLVII, Chapter IV) suggest that while 
there may be a relative leveling off of skill in the "every- 
day" use of language by the time students reach high school, 
there is a considerable development in the ability to 
respond to the more subtle linguistic values which are 
frequently found in poetic language. This finding appears 
tOwcontli cl with Abbott sand “Prabues Suggestion chatepeerry 
bevdetercdsromethe hrgh schoo! "curriculum, aud supports: the 
view that while active interest in poetry itself may be 
lacking during the high school years, the skills underlying 
the capacity to appreciate poetry are undergoing a consider- 
able transformation at that time. It may well be that these 
underiving linguistic skille "are highly “capable of develop— 
ment in most high school students, and that this development 
has been hindered in the recent past by negative societal 
attitudes toward poetry and by a lack of imaginative 
teaching approaches. 

4, The interview results repeatedly indicated a lack 
of correspondence between knowledge of poetic nomenclature 
anaethewabriaty to respond skilpually to che varvous aspects 
of poetic language which were tested (see the sample type- 
scripts in Appendix D). This suggests that knowledge about 
poetic structure and about the various poetic devices is of 
Piveele value without repeated practice in applying this 
knowledge. The "variant versions" technique used eee ss 


study appears to be a workable means for providing such 


practice. 
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Jeane Lhe; dows correlation between performance on the 
“Thought" Subtest and performance on the other three subtests 
suggests that it is entirely possible for a student to have 
a good grasp of the discursive meaning of a poem and yet be 
seriously deficient in sensitivity to such aspects as sound 
and suggestion. Thus teaching and testing which are con- 
fined to "thought content" appear to be inadequate in terms 
of the total experience a poem seeks to convey. 

6. The study findings strongly suggest that there 
are considerable individual differences in the way various 
students apprehend "poetic", or "imaginative" language. Some 
tend to delight in and linger over the sounds and suggestions 
of words and phrases, while others are aware only of their 
symbolic function. This finding, though merely serving to 
confirm what most teachers of literature are well aware of, 
underscores the need on the teacher's part to take these 
personal differences into account. How he deals with them 
is beyond the concern of this study. 

7. The interview results indicate that most 
stiudente..6 asked, can bring what often «appears to be yan 
instinctive knowledge of the way words operate to a con- 
scious level and can discuss the uses of words with 
relative clarity, sense, and interest. The oft-cited 
belief that high school students are either unable or 
unwilling to think consciously about the operations of 
language is not supported by the present Sud. 


8. The interview results suggest that the close 
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scrutiny of individual words and phrases is compatible with 
a high level of enjoyment in reading poetry. Indeed, the 
degree of enjoyment for the students interviewed appeared 
to be directly related to an ability to read a poem 
intensively. 

Jee the efector analytieuresul us, in econtliceimasy ren 
the fairly traditional organizational scheme used in the 
construction of the Poetry Test, suggest that the way 
poetry is normally broken down into its various components 
for teaching purposes should perhaps be replaced by a 
dyiterene type of organization, possibly based Jon Minturvive: 
versus "analytical" uses of language. This suggestion is of 
course highly speculative and demands a great deal of further 
study. 

10. The "variant versions" technique used in this 
study appears to offer promise both in the teaching and 
PeSetigeOrs DOLLY = ACCOLOINGs LO melee Nn Leuy TeWebeSUs User iit 
technique seemed to be effective in securing the interaction 
between reader and poem which, according to most authorities, 
is a central goal in poetry teaching. Also the study findings 
indicate that this technique may offer a practicable alter-— 
native to testing based either on the factual content of 
specific poems, on a mastery of poetic Terminology, .O Leon 
the general intelligence of the students. If such an 
alternative is considered desirable, as is assumed in this 
investigation, the viability of the present testing 


procedure should be of interest to teachers of poetry. 
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SUGGESTIONS FOR FURTHER RESEARCH 


1. In order to obtain further information as to 
the reliability of the Poetry Test, the test should be 
administered to a larger sample of students, with each 
Student disWering both» tormseis Alco, sor Lhe purpose of 
increasing reliability, each form test could be doubled in 
length and administered in two sittings. 

2. The present study could be repeated with both 
university and high school students for the purpose of 
comparing the responses of the two groups. 

3. The four categories developed for the Poetry 
Test could be modified or reduced in number in an attempt 
to gain additional insights into response to poetic 
language. 

4. The testing procedure developed for the present 
study could be used to examine response to a single 
component of poetic language, such as metre, imagery, or 
tone. This more detailed kind of investigation would seek 
answers to such questions as the feelings ‘suggested by the 
present study: 

(a) In what way is response to rhythmical sound 
related to other types of sound occurring in poetry? 

(b) In response to a Metrical pattern, What are 
the relative effects on readers of line length, number of 


feet, regularity of flow, and suitability of metre to the 


poem's total meaning? 
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(c) Is there a strong connection, as suggested in 
this study, between Lesponsescor tone! Vand) the maturity of 
thewreader? 

(d) What is the relationship between the effect of 
the sound of a word or expression and its suggestive or 
connotative meanings? 

(e) To what extent and in what ways are readers 
apfecteanby the ecennotative Wicolouring™), or intensity,6of 
a word like "shadows" or "tarnished", Gegerdles= RO mm—iKes 
appropriateness to its context?" 

oem Dhestesting=procedure: used an this! studyscoulld 
be modified in a number of ways. The "parts" to be 
matched could consist of two or more lines rather than a 
Single word or expression, though the resulting increase 
in the scope of response may be offset by a loss of 
precision in measurement. The poems comprising the items, 
iieaddweion to tbeing printed, scould be read “aloud to 
respondents to test possible effects on response. Certain 
key words and phrases in the context could be underlined 
tondetermine the effect wotechis kind Otvelue ings shcss 
pondents could be told which kind of skill each item is 
measuring to determine the effect of knowledge of the 
correct dimension on item difficulty level. 

6. The effects of a training session on response 
to the various components of poetic language could be 
investigated. An experimental group could be shown the way 


metre, word sound, and the suggestive qualities of words 
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and phrases contribute to the total meaning of a poem, and 
its results compared with those of a control group. 

7. The "variant versions" technique employed in 
the present test could be applied to fictional and other 
prose passages, deleting for testing purposes such peculiarly 
poetic elements as metre and rhyme and retaining such general 
elements of imaginative language as imagery, connotation, 
word, soundsmand»'tone.?" The results ‘of such a test could 
tiene bemcorrelated withreswitsetor a poetry test similar 
tomthe present one for the purpose of obtaining further 
rate on regarding the relationship between response to 
poetic language and response to imaginative language found 
outside poetry. 

8. The Poetry Test used in the present study 
should be administered in conjunction with a test measuring 
knowledge of poetic terminology to determine what relation- 
ship exists between the two kinds of performance. Such 
knowledge may be of practical benefit to teachers of 
poetry. 

9. The three factors tentatively identified in the 
present study could be further investigated through attempts 
to construct factor-pure tests for each of these three 
factors. This would appear to be a rather extensive 
process, involving sequences of tests, each a refinement 
of previous ones. 

10. The relationship between response to "ordinary" 


or discursive language and response to poetic language needs 
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to be investigated. Knowledge of this relationship appears 
fundamental to the teaching of any literature employing 
imaginative language, particularly poetry. Before such 
investigation can be adequately undertaken, however, there 
is a need for more sensitive and comprehensive means for 
measuring response to discursive language than are offered 
by current tests of reading comprehension and vocabulary 
skills. “The construction of such instruments would) seemato 


be a most useful kind of research. 
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To the Student 


This 18 a@itestiwhichetrics totmeasurei,your awareness of 
certain ways a poem operates. In each question, one of 
the four alternatives--the "right" answer--belongs to the 
OFiginal fpocmeamtsSeo a fevou tcoam sole Sieteuwlby using any 
clues” VOUsSGAnM FI ndtingehe resimice thes imnes. 


Don't worry if you don't completely understand any poem. 
Tne) test PIoesenot casi you tomgive Igeeconsiarer Byour 
choices; if certain alternatives just "sound better" to 
you, fine. 


Try to avoid wild guessing, however, and try to examine 
the poems carefully before choosing, because some of the 
Clues sare NOM sLOGMObDVMOUS. | Ltivhas been found) chat 
experienced poetry readers need about two minutes for the 
average item on this test. 


Toankyyoueror tTourvuwhbelpay Elacesalianswems on the tsb eM. 
answer sheets. Do not write on the test paper. 
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Though he believe it, no man is SCO 
He thinks torbe called thenftortunate, 
To bring home a wife, to live long. 


But he is defeated; let the son 
Sell the farm lest the mountain fall: 
His mother and her mother won. 


His fields are used up where the moles visit, 
the contoursaworn, Slat: tf there show 
Passage for water he will miss it: 


Give up his breath, his woman, his» team; 
No life to touch, though later there be 
Big fruit, eagles above the A 


hitis 
river 
sea 

: stream 
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When I play on my fiddle in Dooney, 
Folk dance like a wave of the sea; 
My cousin is priest in Kilvarnet, 
My brother in Mocharabuiee. 


I passed my brother and cousin: 
They read in their books of prayer; 
Liread j~nimy book ofssongs 

te poughtirat. the wiligo. fan. 


When we come to the end of time 

TNoePeteui sitting inestatke,; 

He will smile on the three old spirits, 
through “the*gate} 


For the good are always the merry, 
Save by an evil chance, 

And the merry love the fiddle, 
And the merry love to dance. 


And when the folk there spy me, 

They jwill-allecome up cto xme, 

With 'Here is the fiddler of Dooney:' 
And dancesliketaiwave or the wsea, 


1. And call ethem ficsc 
2. And welcome us all 
a) But call mewbixse 
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Then hate me when thow wilt? “lfVever, now! 
Now, while the world is bent my deeds to cross. 
Join with the spite of fortune, make me bow, 


And do not drop in for an after-loss. 

Ah, do not, when my heart hath scaped this sorrow, 
Come in the rearward of a conquered woe; 

Give not a windy night a rainy morrow, 


to dinger out va purposeac soverthrow. 

If thou wilt leave me, do not leave me last, 
When other petty griefs have done their spite, 
But in the onset come. So shall I taste 


At first "the very worst cf fortunes mreht; 
And other strains of woe, which now seem woe, 


Compared with will not seem so. 
1. loss of thee 
2. present pain 
Be Pr SCOln 2Om ties 
4. thy great love 


Twirling your blue skirts, traveling the sward 
Under the towers of your seminary, 

Go listen to your’ teachers old” and” contrary 
Without believing a word. 


Tie the white fillets then about your lustrous hair 
And think no more of what will come to pass 

Than bluebirds that are walking on the grass 

And chattering on the air. 


Practice your beatity, biue girls, before aiekai ly, 
And) l will cry with my oudelivswandgrun lien 
Beauty which all our power shall never establish; 
Pees -sOmmrai. 


For =f could tell vyvou a story whreh is true; 

Peknow a “addy witha “terribiescongue, 

Blear eyes fallen from blue, 

All her perfections —BVeteitel se nOusL Ong 
Since she was lovelier than any of you. 


1. ended 

Dew eLorgoccel 
3. rained 

4. tarnished 
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With blackest moss the flower-plots 
Were- thickly crusted)@oney and all; 
The rusted nails fell fromthe knots 
That held : 
ihe brokenWsheds “Lookeau sade and strange: 
Unlifted was the clinking latch; 
Weeded and worn the ancient® thatch 
Upon the lonely moated grange.1l 
shesonly sald, "My litesis dreary, 
He come thane," shersara: 

She said, "I am aweary, aweary, 

I would that. I were dead" 


»- the pear to the gable wall 

Ehev pears COs eneerOceIngsolauwald 
thevpear <ree= to ther cottage wall 
. the®pear treetto the old wall 
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Avenge, O' Lord,” they Saints, whose bones 
Lie scattered on the Alpine mountains cold, 

Even them who kept thy truth so pure of old 

When all our fathers worshipped stocks and stones; 
Forget not, ain -thyebook’record their groans 

Who were thy sheep, and in their ancient fold 

Slain by the bloody Piedmontese, that rolled 
Mother and-infant down the rocks. Their moans . 


butchered 
fallen 
murdered 
slaughtered 


& WN FE 


Ana I have felt 
A presence that disturbs#me wrth them oy 
Of elevated thoughts; a sense sublime 
Of something far more deeply interifused, 
Whose dwelling is the : 
And the round ocean and the living air 
And the’ bluéecsky and=in thes mindy ofeman; 
A motion’ and a spirit thateimpels 
AlIVthinking things, eal ebyects OL@ali@rhought, 
Anderolls throughtaliw thangs. 
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He clasps the with crooked hands; 
Close to the sun in lonely lands, 
Ringed with the azure world, he stands. 


The wrinkled sea beneath him crawls; 
He watches from his mountain walls, 
And like a thunderbolt he falls. 


eT em obese 
Zum CLaGg 
3 EC. ise a 
a. "rock 


I like to see it lap the miles 
And lick the valleys up, 

And stop to feed itself at tanks; 
And then; prodigious; step 


Around a pile of mountains, 

And, supercilious, 

In shanties by the sides of roads; 
And then a quarry pare 


To fit its sides, and crawl between 
Complaining all the while 
Inehonerd, shooting estanza; 
Then chase itself downhill 


And neigh like Boanerges; 
Then ;spunetual  .asma stay, 

Stop, — docile fandwomntporenta— 
Ato-ts sown stable deo, 


1 (ekeene 
Yee KEN 
SS Siecle 
Awe aze 


Punctually at Christmas the soft plush 

Of sentiment snows down, embosoms all 

The sharp and pointed shapes of venom, shawls 
The Hillis and Nidesmene: shocking nO less ol sti 
Uneven world of want and wealth, cushions 

With cozy wish like cotton-wool and cool 

Arm's length interstices of caste -andgclacs 
And into obese folds subtracts from sight 

All truculent acts, bleeding the world white. 
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EO. (Continued) 


PUNnCtualiyeathattigiib pair, 
Emerges royally to stake ithe air, 
Collect the bows, assimilate ~Eheacmiges: 

Of waiting men. It is a genial time; 

Angels, like stalactites, descend from heaven; 
Bishops distribute their own weight in words; 
Congratulate the poor on Christ-like lack; 

And the member for the constituency 

Feeds tie rive thousand, and Mas plenty back. 


, 


ul Greed and Deceit 
2... Kindnesswand Love 
3. Peace and Goodwill 
4, . Vanity and Pride 


EARS Fear no more the heat o' the sun 
Nor the furious winter's rages; 
Thou thy worldly task hast done, 
HOMewart gone and; ta‘en thy wages; 
Golden lads and girls all must, 
As chimney sweepers, come to dust. 


Fear no more the frown o‘ the great, 
Thou art past the tyrants stroke; 
Care no more to cliothe and eat; 

To thee the 1S asthe oak: 
Thetsceptre learning) Pphysicyemuse 
All foblowothis andScomeitotdustcs 


Fearkno more gties@lightning, {lash 
Nor the all-dreaded thunder stone; 
Fear not slander, censure rash; 
Thou hast finished joy and moan; 
All lovers young, caliseOovers must 
Consign to thee, and come to cdusc: 
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ButialouBai 1 Vs 
defunct 
who used to 
ride a watersmooth-silver 
stallion 
and break onetwothreefourfive pigeons just like that 


Jesus 
he was a handsome man 


and what i want to know is 


NS 


ii vnow CanNauman so bursting with lve 
go live with Death 
gum ROWRCan Ehiefyilda spirit dive 


with Death 

3. how do you like your blue eyed boy 
Mister Death 

4. what business do you have with such a man 
OBDearh 


I did not lose my heart in summer's even, 
Whenmroses 6 Lhesmoonrises burst apart: 

When plumes were under heel and lead was flying, 
In blood and smoke and flame I lost my heart. 


ieost) tt. to: a soldier F 
Ampchappenat) did notekitil me, eoutane ered: 

That) took VeheesabresstraLlghe pend seookgue ystriking 
And laughed and kissed his hand to me and died. 


te ana astoe 

and a foeman 

- who was a foeman 
who was my foe 
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For I have Known them all already, known them all; 
Have known the evenings, mornings, afternoons, 

I have measured«outemy lite withecoitee spoons; 

I know the voices dying with a dying fall 

Beneath the musschrromealsarlhereroom: 

So have should I presume? 

And I have known the eyes already, known them all - 
The eyes that yOu In) a. lOLrmula ted = phrasc, 
And when I am formulated, sprawling on a pin, 

When I am pinned and wriggling on a wall, 

Then how should I begin 

To spit out all the butt-ends of my days and ways: 
And how should I presume? 
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4% (Continued) 
ee ease 
2 *set 
OM sCacch 
40 shold 
on Natures first green asmigold, 


Her hardest hue to hold. 
Her early leaf's a flower; 
BUEHOnT Soman sou. 

then leaf subsides ‘to leaf. 
SOLECen sank LOsgrier, 

So dawn goes down to day. 


Nothing Can estay. 
thy - tefeulWel 
Za good 
Be) spune 
es bp azote 
UG. The lowest trees have tops, the ant her gall, 


The fly her spleen, the little sparks their heat; 
The slender hairs cast shadows, though but small, 


‘ 
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Seas have their source, and so have shallow springs; 
And love is love, in beggars as in kings. 


Where rivers smoothest run, deep are the fords; 

The dial stirs, yet none perceives it move; 

The firmest faith is found in fewest words; 

The turtles! cannot Sing, and yet they love: 

True hearts have eyes and ears, no tongues to speak; 
They hear and see, and sign, and then they break. 


14 ciAnd bees ialinhavettheirr stings although they 
Dey no Gagueau 

2. And bees have stings, although not great 

34 WAnds bees? i "stings™are most) painful, though noe 
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4), And’ bees haverstings although they be not 
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And 


ionave Stood still) and =stopued (tne sound of feet 


POETRY Thol 6 


been one acquainted with the night. 


walked out in rain - and back in rain. 


outwalked: the furthest) cityemgnit. 


looked down the saddest city lane. 
passed by the watchman on his beat 
, unwilling to explain. 


When far away an interrupted cry 
Came over houses from another street, 


But not to call me back or say goodbye; 
And further still, at an unearthly height, 
One luminary clock against the sky 


Proclaimed the time was neither wrong nor right. 


I have been one acquainted with the night. 


Others, 


ches 


dropped my eyes 
tipped my hat 
Eurned around 
smiled at him 


Leen NOt sthemtidinstm, 


Have willed more mischief than they durst: 
Leeine the breathless nightel too 
Shiver now, tis nothing new. 


More® tian sl] ert Peruchewere -cotd, 
Have stood and sweated hot and cold, 
And#through their@veins. vn tee and=1ire, 


contended with desire. 


Agued once like-me were they, 

But I like them shall win my way 
lastly to the bed of mould 

Where there's neither heat nor cold. 


But from my grave across my brow 
Plays no wind of healing now, 
And fire and ice within me fight 
Beneath the suffocating night. 
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Staged 

In the Park In the Park 
With long spear lights From dusk 
Ride at each other To dawn, 
Like armoured knights; The tourney goes on: 
Rush, Rush, 
Miss the mark, Miss the mark, 
Bierce ptheudark, Pierce the dark, 
Dash by! Dash by! 
Another two Another two 
‘vy Lays 

1. Bikes 

2 tmueoyvs 

Bis Aches 
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I dreamed of war-heroes, of wounded war-heroes, 
With just enough of their charms shot away 


To make them more nandsome. The women moved nearer 
To touch their sorave wounds and sbhear sharin streaked 
with gray. 


I saw them in long ranks ascending the gang-planks; 
The girls with their doughnuts were cheerful and gay. 
They minded their manners and muttered their thanks; 
The Chaplain 


They shipped these rapscallions, these sea-sick 
batallions 

To.a (pacLiotic veandyp1eLusesqdue 1sp0 te, 

They gave them new bibles and marksmen's medallions, 

Compasses, maps, and committed the lot. 


Peetine dust sdhas cevuled: on lal bethatescrap metal 

The heroes were packaged and sent home in parts 

To pluck at a poppy and sew “on a petal 

And count the long: night by the stroke of their 
hearts. 


*. ‘Satiderto wateh yandiecO pray. 

advised them to watch and to pray. 
» Yadvisea them to watch) andgpuay. 

, Ssaidvto: watchWands pray. 
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When I have fears that I may cease to be 
Before my pen has brain, 
Before high-piled books, in charact'ry 

Hold like rich garners the full-ripened grain; 
When I behold, upon the “night's starred face, 
Huge cloudy symbols of a high romance, 

And think that I may never live’ to trace 
Their shadows, with the magic hand of chance; 
ANG Swhien Il reel wralmecreaturesotean nour’ 
That I shall never look upon thee more, 

Never have a relish in the fairy power 

Of unreflecting love - then on the shore 

Of the wide world I stand alone, and think 
Till love and fame to nothingness do sink. 
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gleaned my teeming 
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O, pardon me, thou bleeding piece of earth, 
That I am meek and gentle with these butchers! 
Thou art the ruins of the noblest man 

That ever lived in the tide of the times. 

Woe to the hand that shed this costly blood: 
Over thy wounds now do I prophesy 

(Which, ike dumb mouths ao ope their ruby lips 
To beg the voice and utterance of my tongue), 
A curse shall’ ivont upons them limbseor men; 
Domestic fury and 

Shall cumber al Pathe "partswor tally, 

Blood and destruction shall be so in use 

And dreadful objects so familiar 

That mothers shall but smile when they behold 
Their infants quartered with the hands of war, 
AVY pity “choked with (custom of reli, deeds: 
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2 moi. Stipe 
3. fierce violence 
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When God at first made Man, 

Having a glass of blessings standing by; 

Let us (said He) pour son him all we can: 

Tet the world's riches, whichwedispersedeiic, 
Conteacteimltomagspan. 
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(Continued) 


So strength first made a way; 
Then beauty flowed, then wisdom, honour, pleasure: 
When all was almost out, God made a stay, 
Perceiving ithat alone, wot.alinhis treasure, 

Rest einecnesbotrom, bay. 


POM st Uershoulde (said re) 
Bestow this jewel also on my creature, 
He would adore my gifts instead of me, 
And rest in. Nature, not the God of Nature: 
So both should losers be. 


Yet let him keep the rest; 

But keep them with repining restlessness; 
Let him be rich and weary, that at last, 
If goodness lead him not, yet weariness 


. May toss him to my breast 

May yet toss him to my breast 

May toss him finally to my breast 

May “fina livetossshim=toemy, patient breasec 
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The rich man has his motor car, 
His country and his town estate. 
He smokes a fifty-cent cigar 
And jeers at Fate. 


He, f£rivols, through, the liveiong day, 

He knows not Poverty her pinch. 

His lot seems light, his heart seems gay, 
He has a cinch. 


Yet though my lamp burns low and dim, 
Though dy must slave tom liveiinood — 
Think you that I would change with him? 
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Strephon kissed me in the spring, 
Robin in the fall, } 
But Colin only looked at me 

And never kissed at all. 


Strephon's kiss was lost in jest, 
RODS BUCS timi 1 jp. lays, 

But the in Colin's eyes 
Haunts, meynightirand day. 
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Keep me from going to sleep too soon. 
Come wake me; up. Come any hour 
Of night QGome whistling up the road, 
StoMp On the porch. Bang on the door. 
Make me get out of bed and come 


Tell me the northern lights are on 
And make me look. Or tell me clouds 
Are doing something to the moon 
They never did before, and show me. 
Seenthat dy see.0) Tadksito: me tv 
I'm half as wide awake as you 

And start to dress wondering why 

I ever/iwent to bed at all. 

Tell me the walking is superb. 

Not only tell me but persuade me. 
You, know. I ‘mn not weoorhard persuaded. 


And, open uppthe doom) andiaicght, avkughe 

And slat yousimeends 16g the #atchen agit 
And det yous and Lighter’ aight 

w. And Vets yougn nie: Eheasoht 
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Where had I heard this wind before 
Change like this to a deeper roar? 
What would it take my standing there for, 
Holding open a restive door, 

Hooking downy hit torarsrothy shore? 
Summer was past and day was past, 
Sombre clouds in the west were massed. 
Out in the lporch Ss leacqanem: too, 
Leaves GOtsup sinned and hissed, 
Blindly struck at my knee and missed. 
Something sinister in the tone 

Told me my secret must be known: 

Word I was in the house alone 

Somehow must have gotten abroad, 

Word i tad no one tert. but God. 
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Drum eon *VOurry ariums, on your banjoes, 
Sob on the long tcoomiwinding Saxophones, 
GOP LO eit, OF jazgzmen™ 


Sling your knuckles on the bottoms of the happy 
tin pans, let your trombones ooze and go 
husha-husha-hush with the slippery sand-paper. 


Moan like an autumn wind high in the lonesome 
treetops, moan soft like you wanted somebody 
terrible, cry like a racing car slipping away 
from a Motorcycle cou, soang-bpang. Vou jazzmen, 
bang altogether drums, traps, banjoes, horns, 
tin cans - make two people fight on the top of 
a stairway ‘and scratch each other's eyes inva 
Clinch tumbling down the stairs. 
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UButs hear. L£ you stay, and the childybe born, 
It will pass as your husband's with the rest, 
White wen we dily pethie= teeth Orecconn 

Will be gleaming at us from east to west; 

And the child will come as a life despised; 

I feel an elopement is ill-advised." 
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(Continued) 


"eyou realize motewhat wteici my dear} 

To a woman! Daily and hourly alarms 

Dest (ihe Grutheshouid “outa. How een I stay here 
And nightly take him into my arms! 

Come to the child no name or fame, 


Let us , and bear the shame." 
Im Stayiwend faces: t. 
265 JO, and hide ib, 
Secotay, anduhade eit, 
A. gO, and’ face at, 


The pale purple even 

Melisearound thy flsgght: 

Like a star of Heaven 

In whesbroadacayiight 

Thou art unseen, but yet I hear 
thyeishradleadelaght: 


Keen as are the arrows 

Of that siiver sphere, 
Whose intense lamp narrows 
In the white dawn clear 
Until we hardly see - 


All the earth and air 

With) thy voice is) loud, 

As, when night is bare, 

From one lonely cloud 

The moon rains out her beams, and 
Heaven is overflowed. 


we feel it there. 

we feel that it is there. 

bu yeu wewtecietnatii Ss) there. 
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fet the boy try slongethis bDeyoneu Dilade 

How cold steel is, and keen with the hunger of blood, 
Blue with all malice, like a madman's flash; 

And thinly drawn and famishing for flesh. 


Lend him to stroke these blind, blunt bullet-heads 
WhichmlLong mato) DUzZc cul imsemte hearts OL : 

Or Give him Cartridges ser fine zinc teeth, 

Sharp with the sharpness of grief and deacne 
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(Continued) 


For his teeth seem for laughing round an apple. 
There lurk no claws behind his fingers supple; 
And God will grows no talons at his heels, 

NOx antlers through. thesthickness of his curds. 
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Smuggled sibilants, 

Rattling pages, 

A muted yawn, 

someone ages away, 

Faint footsteps overhead, 

A clicked looseleaf, 

Desultory drumming of bored pencils; 
A faintly sweaty, chalky smell; 

A weary, yet taut expectation 
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» muttering 
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APPENDIX B 
Poems Used for the Poetry Test ltems 


and their Sources 
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We H. “Auden. "Chorus from "Paid on Both Sides," in 
Selected Poems. London: Faber and Faber, 1938, 
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W. B. Yeats, "The Fiddler of Dooney," in Norman 
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MacMitlan; 19627 ps 56. 


Wm. Shakespeare's "Sonnet 90," in Shakespeares Works, 
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John Crowe Ransom, "Blue Girls," in Oscar Williams, 
ed., A Pocket Book of Modern Verse. New York: 
Washington Square Press, 1954, p. 350. 


Alfred Tennyson, from "Mariana," in James Stephens, 
ed., Victorian and Later English Poets. New York: 
Amérrean Book Company, 1934, pH 6: 


John-Milton;, from “On@bhe Late Massacre in ‘Picamone, 
in Laurence Perrine, Sound and Sense. New York: 
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Wm. Wordsworth, from "Lines Composed a Few Miles 
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Alfred Tennyson, "The Eagle," in Laurence Perrine, 
Sound and Sense. New York: Harcourt, Brace, and 
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Emily Dickinson, "The-Ravlway Prain;,” “in Oscar 
Williams, eds, A Pocket Book/or Modern Verse. New 
York: Washington Square Press) §195275p. 62. 


We Re "Rodgers, from="White*@nnlStmais = =i Oscar 
Williams, ed., A Pocket Book of Mecern Verse.» New 
York: Washington Square Press, 1954, p. 507. 


Wm. Shakespeare, "Fear No More," in Laurence Perrine, 
Sound and Sense. New York: Harcourt, Brace, and 
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Petre cummings; "Portrart Vili, Sins luours Untermevyer, 
Modern American Poetry. New York: Harcourt, Brace, 
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A. E. Housman, "I Did Not Lose My Heart," in The 
Collected Poems of A. E. Housman. New York: Hole, 
Rinevarte; PNG sp eels o. 


i. so. Eliot; tirom*"tne LoverSong of ii AeAltred 
Prutrock, Sin ThesCollecred Pocus offen, Seenidou. 
Hondon: Faber and Faber, 1963, p. 1s. 


Robert Frosty «"Nothing scold "Can Stay," in The Poems 


of Robert Frost. New York: Random House, 1946, 
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Thomas Dyer, "A Modest "Love," “in WNorman@Ault, ed. , 


Elizabethan lyrica = New evorkwss Caprucorn /eloo0r np. 
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Ropert Frost; «Acquainted with he Night, » in Oscar 
Williams, ed., A Little Treasury of Modern Poetry. 
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Aves Housman; OLners; tl eAMm NOt #LwWewrirst a) in 
Oscar Willtems,9eda., A Pocker, Book Of Modern. Verse. 


New York: Washington Square Press, 1954, p. 170. 


Maidred Weston, "Centraly park Tolrney ,. 1m. Cure. 
DOover,ed=e, Poetry (Toremeo: Holt, Rineharteand 
Winston, LIG4 itp a. 
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APPENDIX C 


Interview ‘Schedule 


vl. 


CM fa 


iIntroduetory, 
i elie > semi nites 
2. Purpose: 


(a) Put student at ease 


(b) Gather general information about students' 
PErcepLions Ofetne test. 


3. Questions: 
(a) Enough time? Too much time? 


(b) How did you approach the questions? What was 
YOUR (Method Ormattack 7d tmanys 


(c) In answering these questions, did you generally 
go by meaning? feeling? sound of words and 
lines? What mainly was being measured? 


(d) - Did «you recall lany lof «therpoems? «Did ithiss 
affect your answering of the questions? 


(e) Do you read poetry for pleasure? Have you 
taken much of 2G in Gschool? lo wyoull we 
what you've taken? What kind do you like? 
Dislike? 

Specific Items 
ieee time - mee bourn4 0eminuces 


Mea ivibvejeyaleiou 


Extract information about students' thought 
processes in answering the questions. 


3. Questions: 


(a)) Whatealibernative did you pick? (reliabiulicy, 
of response) 


(b) Why was it chosen? (which dimension; change 
of dimension; more than one dimension) 


(c) (Th not already volunteered) MWwiateparcs of 
the poem did you use as clues? How did this 
Matching, process cperates 
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Which alternatives were immediately rejected? 
Why? What was your second choice? Why? 


(If "Thought" item) Meaning of the poem. 

(Th “Suggestion, Sound, "Metre tem )arcan 
you name the metre? (or other poetic device?) 
What effect was the poet trying to achieve 

by using itt, deryou think? 

(If not volunteered) Poem - liked? disliked? 


(If not volunteered) Item easy? difficult? 


Other (specify) 


S minutes 


2. Purpose: 


To obtainwany additional intermation, MainlysoOm a 
general nature, not obtained in Part II. 


3. Questions: 


(a) 


(b) 


ce 
(d) 


Was the test measuring all one thing? 
Different things? Ii so, whats: 


What kind of item did you find easiest? 
Hardest? 


Was thertest shard?) Easy 


What did yourthink@ot) theskindschequesticn 
used here? 


Do you think’ this technique would be useful 
as a teaching device? 


Other mspeci ry) 
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Following are complete CVPescLi pts cretworor tne =ten 
tape-recorded interviews. they Were selected because of «a 
desire to represent both grade levels and because both 
respondents were able to express their views clearly and 
coherently. In the first interview that respondent was a 
Grade X girl whose score of 10 placed her at the 98th 
percentile for the Grade X group and ranked her fourth among 
the students interviewed. In the second interview the 
subject was a Grade XII girl whose score of 14 placed her 
at] the®oethe percentile ofvall studentsiwritimaesthe teste sand 
ranked hex #rirst “among the students intervieweas  's" 


Signifies=the student; “"I"°the” interviewer. 


INTERVIEW ONE 


is Tieroduction 
ttem I 
i: prdevyou, fand Lhe "test easvaomenarcac 
Dee Some were quite easy, but there were a couple where 


you really had to think. 

10 Do you read poetry outside of school? 

S: Sometimes. Some of it is a little deep, and you don't 
understand I too well, DULL Tikesto tury coOMUndersuand 
it sometimes. D2 "don teread alter rible lore Wi eadua 
tot or books: 


es DOT YOU WLlite poOcLry sat aul: 

S: Enenol Very Goca aut. 

ite BUC RyOULCOM Cr yee 

Si Yes. 

ies Have you taken much in school? 

oie Welds leering thates 9.) leCOMe © LOmMeAl Deca, sac cus ary 


and we took an awful lot on metres and rhymes and 
things Diké “that” the “last couple of years, and I know 
aliethe patverns, DUC when f.cameghere= tetound that 
they con't Know theses things: 

18 Did you like the poetry you took in school? 

Sie Well some of the poetry we've taken this year has been 


very nice. 
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Do you think what you've taken in school has helped 
Youzgesithesheorsy, weamean, 


Well, yes. For something like this, it sure helps. 


I wonder if it would help you in reading poems. 
Pecan sie really say: 


Specific Items 


SB BSH TE 

Do you remember what you chose for the first one? 
22S. ee. Uewasentmber lien limeprettiyasure. 
Yessyelthatis. the,one,you,choses before.s Good... The 


Main question is Did you have any reason for doing 
thas? 

Yes. dhe) poem.—-1 doneteremenberaif£' wasethinking of 
the pattern but the poem is sort of sad--well, not 
bnealivyesad, but hete=alikesloneily> andeitavous,were 
lonely and you were walking down the street youtre 
not going to smile at a policeman or watchman or 
anything. You're going to do something so that you 
hope he doesn't notice you, and that would mean "drop 
your eyes." 

Okay. “Were there any particular clues or any parti 
cular lines you looked at? 

I think I probably looked at the end--the last line 
in each one and compared, and I looked for internal 
rhyme, in case there was any internal rhyme or 
anything tommake it, fit. 

So you looked for pattern before looking for meaning 
andscouleanlt Gandgany-. 

I den't know, there wasn't an obvious one. 


Item 2 


What about the second question? 

Te mustuhaveybeen goqurltic 

Thaticethbe One Vousdadecnoosc mcaneyouste lL leames why. 
It seems to me the person that's talking here doesn't 
feel guilty for, thegthings headoesvanymoreteaTheyene 
sort of company--I was pretty sure it wasn't "hate" 
or "“love",. because; “love” just<didn|\t go.with thehpoem 
at all. And the “hate"--it wasn't really--suitable. 
So you rejected "hate" and "love" right away, and the 
toss+up was between the first two. 

I wasn’t really sure. 

Welleethe Ollgatial awash cain. 

It was. 

That was your second choice, judging by what you've 


said. 
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Yes. 


SO again you went mainly by meaning? 
Yes. | 


Item 3 


How about question three? 

I'm pretty sure I answered "cars" here. 

Any reason? 

Well, it sure sounds like cars--that's one thing. 
That's their headlights at night. And "steeds"--it 
sounds an tjawiul) dot) liike horses. icot fican't seer horses 
having headiights. Or boys. And--"Bikes"--well-- 
that's one I wasn't sure of because it seems to me 
bikes could ride around in the park. quite easily--you 
know, with lights on, but--bikes don't go that fast. 
They don't speed around too much, so that left "cars". 
Then you used a logical process of elimination? 

Yesr 

"Bikes" was the second choice. 

NESS 3 

SQ, you were) going strictly by meaning? 

Yes. 


Item 4 


Now what about question four? 

Thissonel Tl thank” 1D prckedibys pattern. 

What do you mean by "pattern?" 

Sovtuominke, “"Toutouchtihei rb ravel wounds! wath? taeir 
haiwe streaked® with gray.7 ‘andeiytried” to find? one 


thats matched thatve Advised tehem.tos watch mandito pray '-— 


Teen nko was) that oneyemunberi2r 
Yes. That was the one you picked, and that was the 


Omi ginal: 

Ont 

Could you tell me a bit more about what you mean by 
"Hattern ees Ttitalpat tern oremean ings? 


Well, the meaning would have been just as well if they 
hada “advised ethem tos watchrand pray,j— but ecorwatch 
andi play! Lkepestie pattern up. 

Do you know what this is called? What aspect is being 
tested? 

NOE ISUrEC . 


This is generally called "Metre". Can you label the 
particular metre word here? 

(Silence)- 

Can you say, for example, whether its anapestic or 
dactyids ce 


Well, it seems, in some places torbe anapestic and 
then it changes to be iambic. Maybe it's my 
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imagination. 

Okay. But you picked the right one. Can you think 
Ofewhy the author used this metre? 

(Silence) 

Why did he use a tripping rhythm? 

Well, it sounds very good. 

Well, this is a leading question, but usually which 
rhythm isetor more lighthearted stuff: ) di-dah, 
di-dah, di-dah, or di-dah-dah, di-dah-dah, di-dah-dah? 
The first one. 

Wells, factually 9b sete asecond athat: conveys light- 
Ness p_and he author Seeusine nis Metron anmsabcestic 
way. It's a very grave scene, talking about maimed 
men--guys with their arms shot off, going di-dah-dah, 
di-dah-dah, di-dah. 

Oh, yes: I see! 

Bute thas) is 72 dlc ficule.question. —You see, the 
author is very bitter, and the bitterness is expressed 
ironically, and the metre is used ironically. 

YOu, Canesee it. It sounds like va song, almost. 

Hardly a place for a song. 

Nes. 


Item 5 


How about question five? Which answer did you pick? 
I think it was "gleaned my teeming". 

Yes. Do you know why you picked it? 

"Emptied all my" is definitely out because it's not 
really long enough, in the first place. It doesn't 
sound right. There should be another syllable or 
something. “And "“drainedamy bursting”. “Bursting | 
doesnt sound=ta ght. eAnde = Dicked mye ireiciLeds——ene 
Hast WOrd just didnt eseemeto fat too! weds @AnGeche 
rest of the poem seemed to have the same kind of 
words like "teeming" and "gleaned". 

Tt seems you went by the feeling of the words here 
Pather than Just bys the mean ine. 

Yes. Because "gleaned" is a funny word, but it 
sounded good. 

Exactly. Now it isn't that you know the poem? It's 
quite well known. 

No. 


Item 6 


What about guestion six? 

Tethinkwitewas ‘iterce scivilestrite.. 

Did you know that one? . 

Weiss, actually, slachink tuve heard this somewhere 


before. 
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ites from Julius caccare 

Oh. We took Julius Caesar this year... is thatthe 
mighntbanswerctiar winer oo © 

Yes. And that's the one you picked. Maybe your 
memory was working here. 

Welicjiatofirstiiedidni it recogni zesatye buti whenever 
you're doing any type of multiple choice, if you have 
four answers, and three of them have the same word, 
the one that hasn't got the same word's going to be 


wrong. So I eliminated number 2. "Fierce violence" 
didn't seem long enough--it didn't have enough 
Ssyllables--it just seemed to end. It was a toss-up 


Detweenwicivads war ands lcividestratels. 

Why dideyvouppickelistratels overa (wart? 
Potritelesounded familar; I think at was really 
memory partly. 


Item 7 


Questinn seven? 

Well, here I looked at the other ones, at the other 
end ones, and I noticed that all three were quite 
Shoda, “SOmissaldiae Mayvatosce himecoim ep reastie eis 
that the one I chose? 

Mes.2¢ And’ that's? thes original .weAndhyoumdrdny te do (by, 
meaning? 

No. I don't think I ever read this one (laughs). 

Youn tert your didn?’ tehavey tor 

Not euwelt;, miter Ustfit je dikes “Sopboth shouldgiosers 
ben wn Vayetosss nim to my breasc —-cthey *wercera liane 
same. 

Weds ous Sawsthec patternvesAhndigwou wreqected the other 
three right away? 

Yes, because as soon as I saw how short the other 
lines were I decided he's not going to change in the 
last stanza. 


Item 8 


Now how about question eight? 

Tethonk 1 pickedsnumber 2 here. 

You did, and it was the right answer. 

He sort of wants to surprise you at the end, I think, 
because all of these say the same thing. 

So it isn't a question of ordinary meaning? 

Noe. tile: bowsorteofesurpmise yours ble shsertvotva 


light poem. "You bet I would" just fits best. 
So you matched it for tone. 

Yes. ; 

Have you ever seen this poem before? 

No. 
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Item 9 

How about number nine? 

I said "love". I remember really debating between 
-lOve" anda" kKiceie SiWace Werialate 


You"did "pick "Vovew™ and Mtkiss!¥iwas themoriganals 
Why did you reject the other two? 

Well, "fire" sounds like--uh--passion, and obviously 
if he didn't kiss here there was no passion, and 
"light" sort of sounds soft--more humorous or wise 
or something--obviously wasn't too suitable. Maybe 
Tom) 7UuSe a LOmentic, sont picked love 

“Kiss @'was used l “think, at the metaphoric level, 
and "love" was meant to be straightforward way of 
expressing sthws . 


Item 10 

How about question ten? 

iepacked Siumber “2 —imno fenumber =. 

Yes, it was 3. Can you give any reason. You seem to 


besuncertarnabeouc Wand wc. 

PeknOw © packedone *that ad land Slight a Vvght tat 
the end and when I saw the first one I thought that 
was it but then I realized it was the third one. 
Why did you prefer 3 over 1? 

eltad to go strictly by pattern, | fn numben 2) elie 
word "kitchen" put me off, because the feeling of 
"kitchen" doesn't go with the rest of the poem. 
Bugewihy po Over ile 

Poewwas Spaeceern . 

Can you tell me how many beats to a line? 

eee it Our 

Okay. How many beats in number 1? 

iPethanie four. 

DOmyOu Know wWwiteletnecemanceca Wed: 

Reet. 

Whats tne nameror the erour—LOoou paclern, 


Well, the five is pentameter, but I don"t know the four. 


Fair enough. 


eem Lh 


What about numbes eleven? 
Ie picKed (27. . 
Yes. That was the original, as well)" Why did you 


pLok Site, 

TiLesounds—“welble hereelttsays; = 2tUtgot up wand 
"something" and "hissed", and "struck at my knee and 
missed". It sounds like a snake, and we think of a 


snake coiling, and a snake COCs tee Gi aarO Gm Wihd tada 
OL twistlc Ste econls 
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ee you went by the context, the surrounding words? 
es. 

Why do you think the author used these words for 
leaves-=brought in the snake image? 

It seems to me he's out walking somewhere by himself 
alone, ana it's =sort*orut ike being found out, and 
snake is something we see and it scares you, and he 
Grdnvtewant toubesfoundsout. 


Item 12 


What about number twelve? 

1ecthank ‘bavter™. 

Now OUSpicked™= beat. 

reer Va? 

Yes. Why do you say "batter" now? Was it your second 
choice? 


Pethink sos 
Wheat were you ‘going by? 
(long pause)*=-This one was “eally narae= "= took out 


"strike" and “bang"--both too hard-<-didn't seem to 
fit Le otninke new, WOOkincrdat tyme OOM ite WOW ame 
like "batter" better or not. It seems to suggest how 
you play a banja. 

You were going pretty well by the meaning of the words 
then? 

woae 

Tewas@ crying *to test for sound. 

Was it "batter"? 

Yes: 

wide Pepicked™ beat ees lSsnt te LE funny ewe Coprelk 
"batter" now. 


Item 13 


What about 13? 

i, Vague sb Soakel ciel Golbllelena | Si 4 

Yes; Can you think why? 

Well they sound terribly guilty. 

Can you tell what's happening? “Who's talking first? 
Sounds like a man talking to a woman who isn't 
married. 

Yourctan: realizesthat the Man weralkhingesng ene 
first stage and the woman in the second? 

No. 

The right answer was 4, because he wants to ditch her 
and she loves him. 

Pedidnlte realize this. ©l) tound thissa hard one. 
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Item 14 


What about question 14? 

i ligheveyte cead itragai man lawas looking very much 
at the’ end lines of the,other two StanzZasveonae. 
realized that it couldn't have been number 1 because 
2 was too short. “Twasnitetoo sure whether it 
wouldsstart out withy"butleor not. § I don tuthimpesos 
So you rejected number 3. 

PT ethinks 1 picked number 4% 

The original was number 2. 

Which one did I pick? 

You picked number 4, so you were quite right in your 
Tecollectionssandunumbes 4ahasmandaxteapocatweelhese 
final lines are supposed to have six feet, so here 
three extra ones are needed. 

Ohy, Uscohwooteiedid peiecicn! Gecounk thesextrasbeat 
in this one. 

Puce you were. lookt#ngean the right directaons #Yous just 
didn't look quite closely enough. 

Yes. I should have looked backwards farther in the 
line. 


Item 15 


Number 15. Can you remember which one you picked? 

Yes. I definitely picked one of them over the other 
three. Oh, yes, I picked "lads" because the other 
two--because, like "blade" and "blood," and "apple" 

and "Supple" sort of rhymed. 

Sogyoumyentoby some ykindgoterhyme. TLtyisenotean 
ordinary kindrok crhymeer sDidey oumknowawhiata it). Secalled: 
No. 


No matter. It's sometimes called slant rhyme or half 
rhyme. Very few people notice this. So congratulations. 
Item 16 

Now, the last one. Remember? 

Oh, yes.oeThis was, arcutesone:! dawas wonderingsoetween 
Wwhaispering” and “muttering”. Iwas thanking that for 


alliteration someone whispering would. be better than=-- 
I don't remember now if I put "whispering" or 

Pmt bein. 7. 

Those are the only two that appealed Coyyou; 

Well, "droning! didn tesound right. . 

You did pick “whisperiang/=™ The author used olay lage (3 
Really? (laughs) I guess that's supposed to be a 
teacher. 

T think the reason is that if it were a long way off 
you wouldn't hear "whispering" or "muttering". 
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Yes, but I think I was looking at it in a different 
way. I wasn't thinking of the teacher as talking. I 


thought it was nne of the other people Inthe class: 
Oh oI Soe: 


If you're studying or something, in the back of your 
mind you notice someone muttering over there. 


General Concluding Questions 


Did you feel that any of eG were poor poems? Did 


you (like vor idislike any? “You have to bé really honest 
about this. 
Actually, some you could relate with more. Number 16 


Wesmcutegbecause Licouta*sit there writingdastestuand 
feel it. There were none I really didn't like. Number 
ie thought waswsortrot goed: 

Dovyou think this »kind of gtest)eininot concentnataing 
MGOresonemeaning paMmussesmrootMmuch.eIryetopbe. franks 

It all depends on what you're trying to get. I don't 
think so. 

Whatedosyousthink of this'asea learning device, quite 
aside from a testing device? Where you have to make 
choices and talk about them? 

When you're doing them, you're learning yourself. 

AS wyou get farther -anto the test; yourstart to know 
whateyou*resgorng to lookWior more: 

Do you think it has possibilities as a learning 
device where you make choices and talk about them? 

I think that's a really good idea. You know, talking 
about why someone chose something? I was lucky in 
being in Alberta, where we get much more in this 
pOetry.ascansilOnvandsstult—-—]ltker that veal ly helpeae 
We never took it, like reading poems, as much as this 
theory. leknoWedtiebemei meme rdigie | he it somyou 
should do it at the same time you're doing other 
thangs. 

Neottan uninterrupted diet, then? “But yous tninkeyou 
need it? 

iethinkeyou need 2t. But it has) to bermixed properly. 
The way we took it, they didn’t apply it to poems very 
much. 

So you need a compromise? 

Yes. 


INTERVIEW TWO 


Introduction 


Did you have enough time? 
I finished it, but I would have liked more time to 
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go over it again, because of a few of them I wasn't 
too sure of. 

SO you worked fairly methodically? 

Yes. I looked for pieces that I had seen before-- 
poems I'd read. 

Were there any you had seen before? 

There were a few--from the literature course. 

Did you get any right because you'd seen them before? 
(pause) 

OTK. Youscan tell "me Later se Did you shavevany method of 
attack--any general way of approaching these questions? 
Well, I read the poem over to see what the main ajouke 
Was—--the theme. Then looked at the choices and read 
EE agaii, *puteing the word or phrase! In to see a2 sie 
SOUNGed OlK. Visiter ctcenute tir ties bea hd seclaminate 
char one. | Them Yd try nor the sexact mieaniiic wm lia ke 
for some of them there, the words are just sort of 
Switched around and it could have been either one-- 
it was mostly the way the other--uh~-phrases were put. 
Pt the poet had tal *partictlan "style, say) ne meviced 
his? adjectives or ’sometiing and you could go by thet. 
VOW VOU "Got Ya Teelwmigwabout sine "Scyile=—-Voucd tam tego 
just by meaning? 

No. ) *Because Some of them were so close. 

Did you feel that one thing was being measured, or 
that separate things were being measured? 

I thought several things were involved, 

You mentioned metre for one thing. 

Metre is several of them, because some of the phrases 
opVious ly -ardn "2 fat in. 

Did you see anything else being measured? 
Understanding, and metre, and style, and the language 
that was used: 

How about the sound of words? 

On, that’ was ised im *orne ol them; "too. 

How about the feeling of the words? 

Once you read it over several times, one obviously had 
Coma 62). 

O. K. So you thought different things were being 
measured? 

Cis, gets’ 

Did you feel the test was generally easy or hard? 

Re the beginning, 1 thought it was ampossibie, butlas 
you went along it got easier. 

Did you see that the easier questions were at the 
beginning and the harder ones at the end? 

No. 

This was what was intended. 

Thad alot (of troublemvrchwtie eric Steone. 

Maybe it's a question of conditioning. . 

MWdidn't "do the test in order. if [ recognized any, 
fdiagethat onerethen Peco sthe ones: betore and alter 
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Paty enough, MDid@you find this boring, or wase rt 
interesting enough to keep you going? 
No. I thought it was really interesting. I could 
have kept @going™ tor “anotner hour, 
oe you enjoyed=thi swkindsorecniing? 

es. 

I'm trying to see if there's a relation between skill 
and enjoyment. 

I think the people who wouldn't understand might just 
Say*eSOrget it. bur Ee tnougntm! a Wwas Urea lly, 
interesting and I wanted to find out what I was doing. 


Specific Items 
Item l1 


LT think at's only fair for®me to’ give you time’ seeing 
it's a week away. Any time you want the machine 
stopped, just signal. Do you remember which response 
you gave for number one? 

The first one, because he was unwilling to explain. 
Eippang Nnas®hac’ Vand* smiling @don! tence ine 

So you rejected those. 

THOSE YTwo*ricghteaway.  THisS*’ turning saround: “could 
have” done but--well, at? just isn't something you*d do 
because he's walking. 

You thought that was the second best choice? 

Yes. I went by the meaning, rather than by the 
sounds of the words. 

Bid#vyOuqyernd@=1teecasy Or hard? 

Quite easy. 

Were there any particular lines that helped you? 
Welt, "the phrase right attenr-——-“Unwalling tosexpiaine 
and then I didn't see where he could turn around. I 
saw the whole thing as one continuous action. 

What+do you’ think’ the poet is getting at? 

(pause) i'm not really sure?) 1) dont areally remember. 


Item 2 


How about the second one? 

PeEhink - plekedss cea re 

YOu "dad; =why? 

In that some stanza you've got two other sort of 
opposites--I forget what it's called=—"hot and”™cold”, 


Wiaevandefire ie. And ewase UuSt tryingwto rroure: what 
he *wouldvsay+.-o"'Fear! Sri tein pebut guilt! alsogcould, 
nad "hate" and “desire" could go together. “Hate” 


was out right away. . 
You were looking for opposites? 
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Yeo -lhenalLenerrowed 1tedown to “fear and “hate! and 
then I read it through again, and I think the sound of 
the word. tear! decided me. 

What was he talking about? 

Hedldnit pay attentaongbo the other stanzas. 

it wasn't necessary for the question? 

No. 

Easy or hard? 

Bent’ harder than the first one, because they were. so 

close. 


Item 3 


How about question three? 

imthinks 1. choseutcarc ts 

Yes 

Whats struck me right offi was) “long sspears lights and 
MecankjusStapilceure ther cars coimg) by ~ driving sthroucn 
thegdarkness and thesliqhnts (oeingeahead. sb tnougntere 
could be "bikes" because they just have a single beam, 
and=—~lsdon to know. et fadea bituor trouble ingetiat sone 
Because. eCars: ~iSiplural wubikes (ecu lice leand 
slights, is plural so PE didi! tC make any Gitference, 
5O you were tempted by “bikes™ a bit. 

Buisehen ; whens they rushes by Wit scars jerand site > 
something you can easily picture. 

Whateaboutvehe cditivecultyaom thisrone: 

ELdOnkE Knows el Ad? SO@RESOE put “asc wisch, hem ianms tone. 
PYeLeyecacy:. 

Yes, quite easy. 


Item 4 


NOW) cae BOUGERPOne. 

Lithnink, I chose number cwo, 

aes. 

E.was Darely because Of Ene mumber Of beatcvaing.c 
phrase—-- 1 counted -thias one on myptingerssabourncen 
times. You were close to "said to watch and to 
prey, the first ome, excep. thatthe slbanguege 1s—— 
likey sald eand se advised: —— lanai saci eCistehos 
better--the chaplain "advised"; he didn't say 
anything. 

Then you were going by meaning here? . 
Meaning and metre both. I really liked this one, 
BucevyOupcaw thauedtaveomccouings your wi celingseor 
Metre, —etO GulLLeCedmlardesex lent 7 . 
Well, I didn't think that, that was what was being 
tested, but 1 read aslot of poetry “anyway, and 2s 
Something Ss) not Guiteeniglit, senon@ UabOLher Seine” 
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With the sound? 


Yes. 
Which alternatives did you reject right away? 
Three and four: "advised them to watch and eparenies » tevetel 


"said to watch and pray". 
Something's missing there? 


Yes. 

Can you name this metre? 

No. 

Caneyouscount the number of beats to a line? 
Welte (pase). SING, Sl¥can' tt 


Can -you “perceive why “the guys wsing “this kind of 
metrec? Thetericcusor etn vsexinadsof metue, 

No; "bDutein (the yeirseeline, “medreamed "er war Heroes, 

of wounded war heroes," the emphasis usually comes on 
words that he wants emphasized. 

Do you think this kind of metre is common in English 
poectLny ® 

Probably -noe-. 

LGts notvcommons” But *youMmcant Gseertts “effect? Making 
the line move more rapidly--become lighter-~and yet the 
Subject 2c very heavy--that 1b Ss aekind?! or sarcasine 

I noticed the sarcasm in the doughnuts but I didn't see 
it in the metre. 


Item 5 


How about question five? 

I think number two? 

Yes. 

DeoniunikelL venose 1b) because Wirst: 1 lOoked Lone ches type 
of word used: "picked my freighted" was too hard--it 
JUSEVdidn!t"seem Cbort stein = idrained-mysbur sting” 
and ‘emptied “al P my “=-theslanguage Fwaskind of oul >— 
they Tall kind of méant the’same’ Uniing!-s0 you 
couldn't +«qo by meaning. 

So you went by the feeling of the language? 

Yes. 

Was it the sound of the words, or suggestion, or both? 
BOEnG 

Do you recognize the author? Can you guess? 
On==heaton 

Yes: this is the way he operates. There's a clue, 
though--do you know what "gleaned" means? 

Something to do with harvesting = 

Gouin theinext lainey smetetniere -arvyerysdirect. clue: 
Isn't there something about grain? 

Oly, yes. 

Did this influence your choice? 

Novem = dons think so. 


Coail & gab 2aeue ‘ape 
16 Bole eit) QUbRn a yuy 2 

“peane to) Dads 9h a 

vgeoued rae ig Sansepta” eet v 

yo samec 4 Liaw ROS) ” elie, W ab 

ered eh Ape?’ 2 De 6 os © - ok 

iegipat ai nweer Se. eink BS - Aaias a 4 Se 


inal. G4NdTI° @32) Pas aon nel i) re ma 

7 29)4 Dns Tre 14s weeeog- ube Mae hy f 
nbs egal, 30 Gerd © "99, Jar ‘~wteamt 

o hie 2 eet Siomicsod’ eds Gt weap eS 


“Sey 
: “* 
eet did? Hen Reutge, F apc’ wpheced of) seein Tt iow, T 
4ie—YEin ood aev “sagiy«si: va t botoig"*-: haem 
"at brevis Mam Suits’ al 268 so ees 3" aka 


' om Tei So Cite Bee wpewenal aft--— ve, Sie 


poy ais Jtebdd wage- corte taeGer3o Ges isa | a 
| . ec srean Vd Ct 2 >a 


aorvpiel @c4 Ba x8 Sigs. on i Janw 
ied of \aarseappve ap yiivxced vue 2p a on? pe 
* funaey guy ate Yomwlcon Se Senos 


mf: 2 oe a2eAT Pipa en vom wy BE 
Teresa ” pete tiie weet: 


_ tesapenvied iy iw. OB 
fevia snezlt Wav « » oat, oakt Seo? 
; ‘  <$¢Seap suate: tort bebe manele 


22° | isotody qwoy” aul 


oy « 


a 


© ee ee %o 


et GP) net gph Tol nepy ) | 


ep) 


NH 


(de) eal (ie) te 


NHMNH 


Item 6 


Number six? 

Is this Shakespeare? 

Yes. Do you remember which choice? 

£ think number two. Is that right? 

No. 

No? 

You picked number four, which happens to be the 
Original, 

Ei had a real time trying to figure whichwor thesesit 
Was. ~ Because “wild civil strife"--you really get 
that uplifting, and vou can really feel Ge, sbutetierces 
iso-hargs-anc. you can feel the anger too and I really 
chosesbetween, these’ two. “And ics strange thaty! 
chose the opposite one this time, 

Buta yous chose the. righ ones On.oi ned ls.. 

I can't remember exactly what I was thinking. 

You saw this one as being quite tough? 

YES. silewentrover thicsone tensor wowelve times... 


Item 7 


How about question seven? 
I picked number one. 


YOU Cid. 
I think I went by the last line in each stanza--the 
Hhunber OL Deats in 1b. elne Ciuener Ones s were wal tl etoo 


long and--fer the first and second, I may have 
wavered a bit. 

What was your second choice? 

The second one--there was only one extra syllable. 
Li dadn't really have much=trouble with thet one. 
Did you notice the meaning of the poem? 
Uh--no--it didn't matter to the question. 

Did you) idake this. poem? 

Not much. My favourites! iso fare anc, the;Keats and 
Shakespeare ones. 


Item 8 


What about question eight? 
I think I chose number two. 


You did. 

jeawents throughed e yang) laread 1U ands thougntsi twas 
kind’ of. funny.e) BULL) cuUnny sine aesad kind sol way). you 
bet I would"--it just seemed he was going to grab at 
thesechanuce... “Oheis ee COUulcwawas LOO longing andi! 
wich, 1. COULG" just. didnt isceemela esi hel wave hea would 
Saysit. 1 thank dewould so well he seems) toshave 


really made up his mind. 
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Can you see what I was chiefly trying to measure here? 
(pause) 


fi was after tone. You talked about "funny" and "sad"-- 


I think you were using "tone" terms. 

Yes. 

Basy Or Nara es Likes te omeds = ia kewng? 

I liked it because I can see--he wants a change and 
he doesn't really know, he thinks he knows what he'd 
expect) aaimhelwasepoor. 


Item 9 


What about nine? 
Number two. 


Naka dals 

Diy wes@thesrepetitvonsokethe: word “kiss! and “kissed™ 
kind ofegavermeda hint. “Colanjdoesn"t Seem like he's 
going to be very--he--wild or fiery--he just isn't 
tnateaggressive. | “hight: tha uisemoresunders ond ung 
and: not-[love®or@anything. “And “love’=-that just 
didnt Seen to Bien. SeCOObObyleusem MacCain cewa] 


mainly the repetition. 

BUL, yYOuUsdLdn  t Go .only by that. = vou €limi nated) tne 
other ones for other reasons? 

oar 

So you really attacked it in two ways? 

RCo 


Item 10 


Whatwabouty ten? 
Number two? 
Leer 

Fortva while it was the repetationsof the word "Light#, 
putP lL ealmost chosemtheetirsiesone, GOO, and then 1e 
Say cmulet Voumuntog Lica Cte limita kee om rome 
thati scorcpor Goteme ns Ancnene thi rdgenepardny. quite 
pa eyaish menlialgticn 

So you were going by metre then as well as meaning? 
Did they work together? 

Theyaalimwerked= together. ; 
Again, Can you Saye Now many beats (here are. lo amline= 
Well, this one waseweird. | Us=-roure 
VeECcwEVinates Lt Ccalledz 

Uh--tetrameter? 

Yes, mcOsyOUnaccUa Ming@inew seis: 

But’ Live never--lIudon!t really care about it. 
Anything else about this one? . . 
Oh, yes--the way he broke up sentences--like if you're 
yeadingsaty likeyelComeswakesmeagup ye tien abbreake 
Then "Come any hour"=-itesoundediiwke night sand sort 
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of half asleep. I really liked this one. 
Did you get the meaning of this? 
Not readily. 


Item il 


What about question eleven? 

I chose number two. 

Yesw why? 

themleaves@igotmip im a coil and hissed." |) "Hissed" 
reminded me of a snake and the other ones didn't even 
Pipauel gastereaditharel ine 

Did you see why he was doing this? 

No, except that there were a lot of "s" sounds through- 
out the whole poem. 

Why the snake suggestion? 

Partly the sound. 

You found this quite easy? 

ves 

Did you like this one? 

Not as much as number ten, but it was pleasant to read. 


Item 12 


What about question twelve? 

Letehank put number. 

Yes you did. 

It was between "bang" and "beat", and then I read it 
EhmoucihieAd ete mye) SOUNC Me Deatwdidn te gqurte goat 

in with banjo. 

You were going by sound, quite a bit? 

Yesmienand tthen laterione,y, yousgol esort or a) Gepetzcion. 
Were you tempted by any of the other alternatives? 
VWeetter" and "“Stuikelle noo & Gea, Balwas  meauebust le, 
Just because it was one syllable. 

Guxra ousil yeecnough, “Sandbung, Bille’ poci ym used “batten. 
But, 2b Sipossi > lextnat givens Valet Si aie rem sae. 
thank? ets trying inmbatler eto get amwince Oleworcucs 
Sive: feeling, IWhyhdidmyomw me jeco Mbatten =soereadi ly: 
List didn't sound icity NOW sl Sr ead ite over en 
couldusearmwihy mis Misedy butmliwould st vill rejects ic. 


Item. 13 


Now, question thirteen? 

Titthink I chose number Tour? 

Yousare, raghtu. 

Taremember Gi Hada? lot of trouble with this cme andy! 
had to read it over several times to get the meaning. 
And then I realized it was a dialogue and in the 
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second part there is someone answering. But with the 
"going" and "staying" it was a little bit confusing. 
And) then I decided it had to, be "Going" because she 
decided that she couldn't possibly stay here. 

In which ‘stanzacsis "she" talking?.. Or both? 

The second one. | 

Who °S stalking, in the first one: 

The person whose child it acs. 

Yes. What relation between these people? 

they’ re, lovers, but they're not married. And the 
woman iS married. 

What Sanemtalivingetnvs way in thertirst stanza? 
Because he doesn't want to get involved. He wants to 
Get oubjpor at; 

Yes. Why does she talk this way? 

Because she doesn't really love her husband and she 
sees Rihe whole thing -asmagtickel sour. 

Youre not sure crf ishe loves tehas tquy? 

No. I don't think she does. She might pretend to 
hernselt eshesdoes. "“Sshelsejust trytne toes away. 
Are you left in this poem without really knowing? 
Yes. I think he'll reject her in the end anyway. 
This is Thomas Hardy. 

It's quite apt. 

Didwyvewecand this one ja bit more ditiicule? 

About average. 


Item 14 


How about fourteen? 

I chose number two? 

Yes". 

Poethink Tit wasmthesnumbersotpbeacs. 

Thats tihe obi ginal flaDIdsyou stindganyadiEticuley, pene? 
(pause) teNo, eThis cone f readta Mew, timessgromgthe 
number of beats. 

Dad you get 1t because you knew the poem: 

Noi nL eknew <thespoem) sbutbpledicdnleeknow the cxace one; 
and Lehadakto go throtghwe several stimesyfputeing 
them all in. Like I never actually remembered the 
words. 

Somyou found this fLarmly tough? 

Yes. I think it was harder because I remembered the 
poem because I said "Oh if I get it wrong I'11 shoot 
myself." 


Ttemyk5 


How about fifteen? 
I think I chose number two. 


oF £9 ie tea rue oe sae 


Se eb) eins one 
alts Rta bint: et Wied Uilewe SH anedb edie 8 
» Jain Jeuat? 2 ab o&fa3) shart 
r ins aiky 2eest Sule 24) ape Sans 
otaeterng Sibi aye |. aed ‘cya’ tat Snoh 
vag, 2eo-ot calyad Peni a* ate "noch ae ee 
cavers viles. justalw. tneqneddd oth SEak / 
ieee pie ots ot w48 Joefos dd ee akdserraaee 
| vOesH exstodt ee: 
felout’stey evan ciel a one vids bal? 


sia to - eden ad) saw 3d tatda 2 

ted yer ‘saph Wee M2i2 tery SLC _Seadptap ete eee a 
ais” 109 B Olea “eR haus I oan Gee on oo 

Y sate ke 


ee GD WERT Liny axaiap a wa 
Sin enn? et? otte 4g Fin ee o ri eer aa 
Orsire ; spent? farwuse a P § pene 


erigy .! sivas? liens aa9veu T, sala ~ab he 
nl ’ aw - 

Paipues yirias eins eats 

a) Ps vaiioass L Aes when saw od) stabs DS 


$apqs.i2't Cre ae are Sag 2.%2 AO” Shee Zz unge aame 


=} e%s) 


Yes. Which was that? 

“Lads." Because always through it there was "blade" 
andeepLood! "iach tandem te lesh!. 

What do you call this? 

It wasn't a rhyme. An exact rhyme. 

You don't know this is called half-rhyme? 

No. 


Item 16 


What about sixteen? 

I think it was number one, "droning". 

Yes. VaWhy? 

Because I just pictured a classroom and then the 
teacher Syust droning son fandion tandenele wl ike 1a. tbeay 
you kind of get the--someone droning away--it just 
PEtCied#inwg Wietcouwldn, & bes laughin nowepecaucemt tat 
would mean children but "muttering"--it could have 
been— ~netwrecally “whispering” didn't fab an. 

SO you went by sound? Suggestion? 

Les. 

NOL jwst ysound eh? 

No. First you had to figure out who was going to be 
ages away. 

You've been in this situation? 

eS 


General Concluding Questions 


Any of these poems turn you off? 


Number 15. Kind of a gory image. "Let the boy try 
along thts bayonet bladesnowtcoldestesls Ver ys sYoumgec 
avteelingmof repulsion] Bue ft! was: a®qood@poem: 

You know Wilfred Owen? 

No. 


Anything else you tliked om disliked? 

The Slast one “Though was Lun pf tbecause vot the words 
Prke Sisibilants- < 

How did you feel about’ the test as you wrote it? Be 
frank. 

When “l started ‘f sad “Whats the idea, "and {How am 
I supposed to know what the poet was going to say?" 
So you felt antagonistic? 

Yes) But when “you get. into 71t7;) you really try and 
figures: thout wills tsoF Intexesrings ait, suiascineatingS. 
you want to really get involved. I really wanted to 
find out how I did and what the right answer was and 
how #litcan match Up twuth these people. 
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Yes. I had the same feeling, making it up. Do you 
see this as more or less the same as most poetry 
tests? 

No. The poetry tests we usually get are either 

naming the number of eee ina whine vand alive as 

kind of garbage or you're just given a poem and tiey 
GNSC say Wexpincatcmi worm relate Corie rctytes 

And "What actually happened in the poem?" This was 

much better in that aif you camuse all thesesthings 
ike sound and the number of beats and meaning then 

you'll understand what's being said--like you can 

watch a lot of kids in the classroom and they don't 

really know what they're talking about but if they 

can memorize what somebody else said about the poem 

they get a good mark. 

So you could see I was trying to measure ability to 

apply the knowledge and not just the knowledge itself? 

Atter we'd written it aslo of us were, talking ‘about 
it and some said "I just hated it." and I thought, 
"Well, why?" 

Well, partly because it was difficult, perhaps? 

Yes.) WANG some kvdsejust hates poceny:. 

What do you think Of tts epossibility tas “a teaching 

device, as opposed to a testing device? Say you had 

a group of five students, and you gave reasons for 

your choices, and argued about them? 

This would be better, but they'd have to have the 

basic knowledge in the first place. 

They'd have to be taught how the devices were being 

used? 

Definitely. And you don't get that now. 

And after’ that this kind of thing could be valuable? 

eo 

Do you read poetry on your own? 

Yes. And I take drama lessons and read poetry cue 
Joud.. “And I find tt helos when yourdo=recad 2 out 

LOuUde tOsyOurse la. 

DO yousread snovewonw 

I used to read three or four books a week, and then 

this year I started really liking poetry. And I love 
Shakespeare. 

Have you taken much poetry in school? 

Not too much. 

Do you Siete) 1 like the way it’s handled? 

No. Tt's turning 200 many people againctsi1t.— 106 
Many. set poems. More choice. And they rely too much 

on the older poets but you have to study those to 

realize how these new forms develop. But not too much. 
Have you read Ciardi's book? 

Yes, I have. 

No wonder you did well. You cheated: Do you write 

poetry? 
Sometimes. I try sometimes. But I won't correct it 


or go over it again. 
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TABLE LV 


Form A Item Data Obtained by Using 
Subtest Total Scores 


Item Number Biserial Correl. Item Rel. Index 


SUBTEST ONE (Thought) 


2 205 ou 

S SD on 

10 -60 eS) 
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6 oD Be 
12 258 om, 
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TABLE LXV 
Two-Way Analysis of Variance on Form A: 


Factor A, Reading Level 
Factor. 6B. .Grade 


rrr 
Source of Variation Ss DF MS F p 


SUBTEOL I 


PeeMabne ha pects 1.89 2 ~95 94 ao 
p Dee Malus Et feces 4.40 1 4.40 4.39 .04 
"AB" Interaction a2 2 ft spl 50 
Error Term UL OXS 74 sedehe) 

Homogeneity of Variance Test Chi square = 8.92 jo ey 
SUBTEST. 2 

wAgeMaLy Hirecrs ely, 2 IWS) hese aah) 
TBS eMarn Er tects Lou Ms Dol ro) rata 
"AB" Interaction ikae) Tl 2 ahs! ae Oke: ee, 
Error Term See) 74 <1 3 

Homogeneity of Variance Test Chie squaree=—c55 p= .14 
SUBTEST «3 

vA aMain Ei Leces BBs Suh Z 44 sO, Or 
TBUsMawieEchecus Graz i OS STS) 3.0 
HAB" Interaction 67.00 2 oS “43 SO 
Berome erm Bone: 74 EES) 


Pe ee pe eee oe Se eee ee Se 


Homogeneity of Variance Test Chi square = 4.81 ee ake 
eA Tg et i ee er ee 


Sh.8 ©] oectpe Jno 


——* 


Shi ft 


TABLE LXV (Continued) 
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Source of Variation SS DF MS F p 
a ee ee re eee ee 
SUBTEST 4 

"A" Main Effects 41.96 2 Ps bi) Za Bacal 
"B" Main Effects ad il 14.46 > OW <7 0.0 
"AB" Interaction ERO Ae 2 ee Ont 1.09 woe 
Error Term Cozy 74 3 SIE 

Homogeneity of Variance Test Chi square = 5.70 p= .34 


JeGeb Vi ditaeut 


"A‘eMain Effects 23411: 2 7 Pas Ths 7 OW 

*B" Main Effects 630 Hi O29 14.58 <r OOE. 
Patan Lorac tion ISS ENS 2 ets} od peel Bk 

Error Term SNe Ix, 73) 74 Ler ce, 


Scheffe's Multiple Comparisons of Main Reading Level Effects 


Ai J Conerast Ey p 
ae ee a ee ren es ig re 
i 2 ce it 46 
1 é) lB aye) Drei 207 
2 3 64 63 223 
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TABLE LXVI 


Two-Way Analysis of Variance on Form B: 
Factor A. Reading Level 
Pacton Bb . Grade 


re ee 
TS SS EES 


SOULCetOL wWiarlation Ss DF MS F 


p 
or a ee ee ee ee ee ee 
SUB eo tet 
"A" Main Etftects i Gren 2 3.95 Ais HAO) “i Oyau 
Be eat ob Lecrs Sepsis) ah SU Sy? 05 
TABwelnteraction Si2e2971 2 rae. .49 oiOnL 


Error Term 66.36 74 .84 


Scheffe's Multiple Comparisons of Main Reading Level Effects 


ag J Conctrasic Ay p 

1 Zz = 5108 201 oe) 

it 3 OS 3.41 04 

4 3} EXE Spies) sii) 
Homogeneity of Variance Test Chi square = 4.85 p= .43 
SUBTEST 2 
SAV Main HEtects .08 2 04 U2 6S 
ied ete eci Ss ee i ly 22 eS re Se aU Uae 
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liek ener Meee i 66.50 The 84 
ee ee 
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TABLE LXVI (Continued) 


ee eee 


Source of Variation Sey DF MS F p 


SUBTEST 3 

"A" Main Effects 4.21 2 Za Tea AS 18 
9Be Main hirGecrs 6.46 1 6.46 ay cul “02 
"AB" Interaction e280 a oud oa oo 
Eeroe Tern OGae us i PAP 

Homogeneity of Variance Test Chi square = 7.13 De-wead 
SUBTEST 4 

HAY Main Effects Gor 0 eZ 4.49 4.95 OR 
"B" Main Effects hd 2 it ero BS) S01) 
"AB" Interaction UU ee) 2 S200 Ue Pee OZ 


EYVror rerm Spa carent 79 melee 


Scheffe's Multiple Comparisons of Main Reading Level Effects 


a8 J Contrast bi p 

1 2 aoe sto 46 
Ab 3 -/8 4.89 O01 
2 3 46 Hs OS) ~20 
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TABLE LXVI (Continued) 


source of Variation SS DF MS F p 


TOTAL. TEST 


"A" Main Effects 48.59 2 24029 4.05 ule 


(Bo Matn Et recrs O32 Al Oe neice Soe <0 001 
TAB. interact 7 on 19.68 2 9.84 1.64 aZ20 
Error Term ATS o> 79 aie) 


Scheffe's Multiple Comparisons of Main Reading Level Effects 


I J Contrast 1S 1) 

a 2 45 Rtas ao 
ab 3 A TAS 3 L6 ales! 
Z 3) hi oye Ph of Oe 14 


Homogeneity of Variance Test Chas square =1.0 38 Vip 0 


WEN Slee ee Se 6 ee SS ee 
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LABLE UXV £1 


Two-Way Analysis of Variance on Form A: 
actor Al WVeceabitany tevyel 
Factor B. Grade Level 


a ee IE ee 
SSS 


Sourcesof Variation SS DF MS F 


SUBTEST LL 

"A" Main Effects Oi 2 43 43 aS) 
"B" Main Effects 4.74 1 4,74 4.67 OS 
"AB" Interaction 1743 2 B74 Shas Sno) 
Error Term 15.08 74 dee Os 

Homogeneity of Variance Test Chi square = 12.04 p =). 03 
SUBTEST 72 

MA Maan kitfects eis 2 a0 Thy Sh pss 
"B" Main Effects PPA ONS' uk 2.06 2 09 
"AB" Interaction PESTS 2 okey) oS pals 
EGLO lem Drei S 74 5 Ue 

Homogeneity of Variance Test Chi ‘squareg—7 9599 Dios 
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ee ee eee 


Source of Variation SS DF MS F p 


SUBTEST 4 

"A" Main Effects TE Z cent 4.47 Cel 

 SeeMains Ei rTects 14.10 a on) h6n20 <0 0n 
"AB" Interaction ABA 7) 2 res) de 02 oH 

Error Term 64,79 74 - 88 


Scheffe's Multiple Comparisons of Main Vocabulary Level Effects 


I J Contrast F p 

1 2 0,0 Bh S15) 04 
uf 3 20.0 Si cial .04 
2 3 00 .00 100 


Homogeneity of Variance Test Chi squares —=s 2.50 DP =a= 02 
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Piva mitects 16.93 2) 8.47 1.86 6 
itBEaMainattLecrs 65.21 1 Corea 14535 << 00 
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HO Ge be el 3360.33 74 AIS )s) 


WEA Maia OS) fsehe 2) ee 
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ABLE EXVLIL 


Two-Way Analysis of Variance on Form B: 
Factor Aww Vocabulary LeveL 
Factor B. Grade Level 
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"A" Main Effects ee Oe 2 Gmo ys <a Sesh 
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Scheffe's Multiple Comparisons of Main 
Vocabulary Level Effects 
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a 3 OEE (ese 00m 
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TABLE LXVIII (Continued) 


RR a a ee 


Source of Variation SS DF MS F p 


SUBT EOL > 

"A" Main Effects 223 a 16 Glo ees eg aT 
"B" Main Effects 6.07 i Gre Oi 4.96 2035 
Pape Iinveraction -66 a oo Aad -/6 
Error Term 96.68 ie EL 

Homogeneity of Variance Test Chi square = 2.73 p= .74 
SUBLESL 4 

"A" Main Effects i300 2 Se: head <r UL 
"B" Main Effects 2. 1 PMS OP Pais (hel pane) 
Hobe Interaction 4.42 2 Aege al 2R49 709 


Erron. Lerm le ose 79 sSh0 


Scheffe's Multiple Comparisons of Main 
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3 S oO De <200 
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TABLE LXVLIT (Continued) 


Source of Variation SS DF MS F p 
TOTAL liso 

"A Main Effects oY weceX 0) 2 PSY ee HG 4.42 02 
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TABLE LXIX 


Two-Way Analysis of Variance on Form A: 
Factor A. Comprehension Level 
Factor B. Grade Level 


ee ee ee eee 
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En en ee RE eS A a ot oe oe ie 1 oe 
SUBTEST £ 
"A Main Eitects Loe 2 Shel aad ALO 
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